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ABSTRACT 

Described is the role of the Center for Innovation in 
Teaching the Handicapped (CITH) in Project PRIME (Programmed Reentry 
into Mainstream Education), which attempted to assess the efficacy of 
mainstreaming for 1,035 emotionally disturbed, educable mentally 
retarded, and language/learning disabled Texas pupils in grades 3^5. 
The behavior categories of four classroom observation systems used in 
the project to record types of behavior management, levels of 
cognitive demand, amount of pupil participation, and quality of 
classroom climate are outlined. Details are given on the development 
and contents of training packages for the observation systems (which 
include audio and video tapes) . Procedures are explained for training 
528 observers, for maintaining quality control, and for assessing 
reliability during observer training. Appendixes include time records 
of CITH personnel, and the observations of a workshop trainer. 
(LS) 
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The Role of 

The Center for Innovation in Teaching the Handicapped 

in Project PRIME 

(Programmed Reentry into Mainstream Education) 

M T <;PTmnpl and Meredith Adler 

Acting Di^cior P-j act PRDE Coordinator 

Center for Innovation in Teaching the Handicapped 

Indiana University 

Abstract 

The Center for Innovation in Teadiing the Handicapped developed 
training packages for classroom observation systems, conducted training 
workshops, and maintained quality control for Project PRIIIE (Programmed 
Reentry into Mainstream Education) . a special education re search -evalua- 
tion effort sponsored jointly by the Bureau of Education for the Handi- 
capped CBEH), the Texas Education Agency (TEA), and the Center for Inno- 
vation in Teaching the Handicapped (CITH) . 
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The Role of 

The Centjr for Innovation in Teaching the Handicappeu 

in Project PRIME 

(Programmed Reentry into Mainstream Education) 

M. I. Semmel and Meredith Adler 

Acting Director Project PRIME Coordinator 

Center for Innovation in Teaching the Handicapped 

Indiana University 

Project PRI^Ewas designed to evaluate Texas State Plan A, which was 
developed from State Senate Bill No, 230, a bill passed in 1969 and 
funded for the 1970-71 school year. Under Plan A, special education re- 
sources are allotted to school districts on the basis of the total 
number of pupils in average daily attendance (ADA) rather than on the 
basis of the number of identified handicapped pupils. For each 3,000 
pupils in PDk, a district may receive money for 20 special education 
teadiers, seven aides, and three supportive personnel, regardless of the 
actual special education population of the district. School districts 
determine their educational needs and develop plans for using their re- 
sources to meet these priorities. 

Plan A emphasizes meeting the educational needs of the children 
rather thiUi stressing their handicapping conditions. Flexibility is 
gained by the variety of supportive personnel fiom which a district may 
choose and by a broad program of instructional arrangements. Such ar- 
rangements include resource rooms, the use of itinerant special education 
teachers, and diagnostic classrooms. Because of the emphasis and flex- 
ibility of Plan A, the integration of handicapped children into regular 
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classrooms becomes a real possibility. 

Project PRIME is observing the operation of Plan A and v/ill evalu- 
ate the effectiveness of the individualized programs made possible 
through it, especially those hinging upon integration of handicapped 
children into regular classrooms. The primary aim of the project is to 
determine for whom and under what conditions integration is a viable edu- 
cational alternative. 

Year 1 of the project involved observation and evaluation of 23 
school districts which adopted Plan A for the 1971-72 school year and 20 
districts which were scheduled to begin the program during 1972-73. Six 
hundred and twenty classes in 153 schools participated in the study. 
From these classes, 1.035 handicapped children from grades three through 
five were randomly selected. Those chosen for the study included emo- 
tionally disturbed, educable mentally retarded, and language/ learning 
disabled pupils, all of whom were previously placed in segregated special 
classrooms. One thousand and sixty-six non-handicapped contrast pupils 
were also studied. 

During the first year of the project, descriptive data on variables 
were collected, including data relating to the student, his family, his 
teachers, the classroom, the school, the school district, and the com- 
munity. Achievement testing was administered early in the school year 
and again at the end of the year. A battery of affective and sociometric 
instruTT^ents developed by Agard and Harrison of the Austin Project PRIME 
staff also was administered to experimental and control pupils, their 
peers, and their teachers. 
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Classroom Observation Systems 
In order to exandne the relationships between actual approaches and 
tedvniques used in the classroom and the observed changes in pupils- 
achi«veM=nt. observation instr»ents for recording four aspects of class- 
room interaction-types of behavior management, levels of cognitive de- 
„and, amomt of pupil ^participation, and quality of classroom climate- 
were used. These systems were the Indiana Behavior Management System II 
(Pink 6 Se-el, 1971), the Indiviiaal Cognitive Demand Schedule CLynch S 
Ames. 1971), the Indiana Pupil Participation Schedule CSe-el S Myers. 
1971). and the Florida Climate and Control System CSoar, Soar, i Ragosta. 

1971) . 

The Indiana Behavior Management System n (IB!« ID records on-task 
and off-task pupil behavior. If the child is off-task, the system iden- 
tifies the nature of that behavior. Simultaneously tracking teacher be- 
havior, the system indicates whether the teacher is on-task or engaged 
in a specific control behavior. 

TABLE 1 
CATEGORIES OF THE 
INDIANA BEHAVIOR MANAGEMENT SYSTEM II (IBHS II) 




Pupil Categories 



Behavior 



Description 



Task 



Task Behavior 

Pupil's head and eyes are oriented towards persons 
or objects related to the lesson or lesson in- 
structions. "Lesson" is defined by the teacher. 



4 



TABLE 1 (continued) 



0££-Task Behavior 



1. Sel£- 

invo Ivement 



Student is "alone" and quiet. No verbal or phys- 
ical interaction with others, e.g., staring,, day- 
dreaming, playing with self or other objects, 
muttering to self, wandering arotmd by himself, 
sleeping. 



2. Noise. 



5. Verbal 

aggression 



Verbal and" physical behavior which is noncom- 
municative and disruptive, e.g., slamming a desk, 
tapping feet, whistling, clapping,, singing, etc., 
when not an integral part of the task. 



3. Verbal 

interaction 


Talking when not supposed to; not aggressive, e.g. 
interrupting teacher or another student when in- 
appropriate. 


4. Physical 
interaction 


Non-verbal interactions that are not aggressive: 
playing a game, passing notes', touching someone 
else. 



Insulting.' abusive, angry statements directed to 
peers and/or teacher. 



6. Physical 
aggression 



7. Verbal 

resistance 



8. Physical 
resistance 



Physical attack: punching, hitting, spitting, 
throwing something at someone— directed to peers 
and/or teacher. 



Verbal refusal to carry out teacher's directions- 
either to do a particular task or to stop misbe- 
having. This- only occurs during an interaction 
with the teacher. 



Physical refusal to cooperate with teacher direc- 
tions, "ay include verbal responses, continues 
misbehavior, sits silently refusing to follow direc- 
tions, uses physical force to resist teacher. 
This only occurs during an interaction with 
teacher. 
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TABLE 1 (continued) 



Teacher Categories 




Behavior 


Description 


Task Behavior 


1. 


Task 


Any teacher behavior related to lesson, whether 
social or academic. In general, this includes 
all teacher behavior which has not been initiated 
by a pupil off-task behavior. 


Off-Task Behavior 


1. 


Demand 


Direct verbal commands to *'cease and desist" in 
firm, authoritative tone. No pupil response ex- 
pected, e.g., ''Be quiet;" 


2. 


Value Law 


Teacher explicitly reminds pupil of the estab- 
lished rules of behavior in the classroom by 
describing or referring to a norm of behavior: 
e.g., "You know we raise our hands when we wish 
to speak." 


3. 


Conditioned 
Stimulus 


A "signal" for the pupil to stop misbehaving; 
short phrases and gestures like "O.K.," calling 
the pupil's name, "Sh," pauses, stares. 



4. Criticism- Psychological degradation of pupil with verbal at- 

Demeaning tack, criticism, or sarcasm, e.g., "I suppose you 

think you're being clever!" 



5. Punishment A direct verbal or physical application of nega- 

tive sanctions, including loss of privileges and 
restrictions on pupil freedoms. 



6. Empathy- Teacher expression of his understanding of the 

Sympathetic pupil's feelings. 
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TABLE 1 (continued) 



7. Interpretive 



Teacher statements which explain the reason for a 
pupil's misbehavior, e.g., "You're not paying at- 
tention because you didn't get enough sleep last 
night." 



8. Humor 



9, Consequences 



10. Redirection 



11. Probing 



Teacher efforts to reduce tension and control 
pupil behavior by means of jokes, clowning, 
asides, etc. No intent to criticize pupil. 



Verbal statements stating or implying consequences 
to behavior. Incentives, rewards, or promises are 
positive consequences (Q+) ; threats are negative 
consequences (Q-) . 



Teacher subtle use of "task" to control behavior; 
a positive refocus of attention without reference 
to the nisbehavior. Verbal or physical, but not 
punitive; e.g., "Will you read the next paragraph, 
John?", "Will you and George change seats for 
today?" 



Teacher questions to find out (or get the pupil 
to think about) the reason for his misbehavior. 
The teacher expects the pupil to answer. 



The Individual Cognitive Demand Schedule (ICDS) is an observational 
instrument used in coding different types of intellectual activities 
created by a teacher during classroom discussions. Communications are 
classified into categories of "cognitive demand." These categories are 
arranged in order of their apparent complexity or difficulty. In addi- 
tion, the observer records the kind of response, or feedback, which the 
teacher makes. 
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Low Level Cognitive Demands 




1. Habitual 
Responding 



2. Observing- 

Discriminating 



3. Stringing 



An activity that requires a simple, habitual, al- 
most automatic response. Tliis response requires 
little or no thinking or memory. 

•n.e child is required to notice, j'^^f if^' ^'^/"^ 
describe things which are in front of him (no 
memory is involved.) Tl^e child ^ust reports what 
he obser^/es without having to transform the in 
formation in any way. 

The child is required to make already-learned re^ 
sponses which form a natural sequence. Each part 
of the response suggests the next one to come so 
Sat the child is able to string the response 
witioit much thought: e.g.. spelling, counting, 
reciting by rote, singing. 



4. Remembering 



The child is required to remember and tell some- 
thing he has experienced himself or through read- 
^ng The response does not require any transforma- 
tion of information-- just direct recall. 



High Level Demands 




5. Explaining 



The child is required to pull together information 
and rules and explain the cause of an event TT^e 
^les used in the response are those which the 
child already knows and understands. He is not 
required to construct rules or to interpret them. 
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TABLE 2 (continued) 



6. Defining- 
Classifying 



The child is req\iired to demonstrate his under- 
standing of a concept by supplying the correct 
meaning of a term or by giving the correct label 
for a set of examples. The response may involve 
grouping of various objects, matching examples 
with different labels, giving examples of con- 
cepts, etc. 



7. Applying- 
Coraparing 



8. Inferring 



The child is required to compare and/or contrast 
concepts and to formulate generalizations. 



The child is required to arrive at his own conclu- 
sions, deductions, hypotheses, or interpretations 
from available information. The response should 
involve some new discovery by the child, rather 
than a relation of previously learned facts. 



9. Making Believe 



The child is required to elaborate freely 
idea without any constraints. The response should 
involve free associations and personal and original 
outcc^es. 



10. Value- Judging 



The child is required to judge goodness (worth, 
suitability, etc.) of something or to express how 
he feels about something. The response involves 
making comparisons with an explicit standard or 
implicit one as in the case of giving an opinion. 
Requiring the child to justify his judgment also 
belongs in this category. 



11. Problem Solving 



Behavior 



Going Over 



Tlie child is confronted with a puzzling situation 
and is required to analyze the situation and come 
up with a solution. 



Additional Cognitive Demands 



Description 



The child is required to present a completed as- 
signment (or parts of it) to the ^^1^^°^. ^° , 
tetcher. T.iis includes all tasks which the child 
has completed at some previous time. 



TABLE 2 (continued) 



Clarification 


Before a teacher can make a clarification demand, 
the child should have responded to a previous 
demand. The teacher then asks the child to re- 
peat, rephrase, or revise his previous response. 


Teacher Feedback 


Behavior 


Description 


No Feedback 


The teacher does not respond to the pupil re- 
sponse. 


Positive Feedback 


The teacher ''accepts" the pupil response. She 
can indicate that the response is correct , she 
may praise the child, or she may repeat the child 
response. 



's 



Negative Feedback 



Informational 
Feedback 



The teacher does not "accept" the pupil's response. 
She may scold the pupil for not giving an ac- 
ceptable response or she may criticize the child s 
response, or she may indicate that the response 
was incorrect. 



The teacher provides cues and additional informa- 
tion to aid the child in responding. She may 
direct the child's attention to some item of infor- 
mation, or hint at the correct answer. Sometimes 
she may even give the correct answer. She may ex- 
plain why a response is correct or incorrect. She 
may add information to the response and clarify 
it or she may ask the child to elaborate on a 
previous response. 



The Indiana Pupil Participation Schedule (IPPS) is a simple observa- 
tion coding system designed to record the frequency of pupil participation 
in classroom activities by identifying the nature and number of inter- 
changes between teacher and pupils. 
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TABLE 3 
CATEGORIES OF TOE 
INDIANA PUPIL PARTICIPATION SCHEDULE (IPPS) 



1. Pupil raises hand. 

2. Pupil raises hand; is called 6n by teacher. 

3. Pupil raises hand; is called on by teacher; makes response. 

4. Pupil does not raise hand; is called on by teacher. 

5. Pupil does not raise hand; is called on by teacher; makes a response. 

6. Pupil is not called on by teacher; speaks to teacher. 

7. Pupil asks a question. 



The Florida Climate and Control Schedule (FLACCS) records the climate 
and control aspects of the classroom. Control is viewed broadly, re- 
flecting the structure of the classroom as well as kinds of teacher 
control exercised and the various ways in which pupils respond to this 
control. Climate is viewed as the expression of both positive and negative 
effect by teacher and prpils. 

Each subject was observed a total of seven full school days. The 
schedule of observations, counterbalanced across days of the week, ob- 
servation systems, and observers, was developed by Seimnel and Olson of 
CITO. In addition, it was necessary for the model to maximize the effi- 
cient use of trained coder time in situations where both the number of 
children being observed and distances between school sites varied drastical- 
ly. This criterion was met by providing a plan which could use either a 
six observer or a nine observer base. 
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TABLE 4 

OBSERVATION CODING SCHEDULE 1: SIX OBSERVERS 



One, two, or three pairs 
of subjects/day 



Pass 1--Kids 



A = IBMS II Two Observers: A^ S A2 

B = ICDS Two Observers: B S 

C = FLACCS Two Observers: cj § 

* = IPPS (coded during a.m. only) 

Pass 2— Kids 



Block Day 


^1 




^2 


^2 


^3 


^3 


Block Day 




^1 


^1 






^3 


C3 


(M) 1 


\ 










«2 




(M) 


i 


^1 








^2 


^2 


(T) 2 

1 

(W) 3 


B2 
^1 


*A2 




A2 


h 


B2 


6 


(T) 


1 

22 
23^ 


^2 


^1 


«1 


«2 
Cl 


^1 


A2 




*B. 


A 
^2 


B-. 
2 


c 

2 


*C 

1 


A, 
^1 




(Th) 


24 


A- 
2 


2 


2 


1 


1 


1 












^6 


^6 










^4 








^6 


(F) 5 


h 




*^2 


^1 




C2 




(F) 


25 




*A 

2 






^2 




(M) 6 
(T) 7 






^2 


^2 
^1 




^2 


7 


(T) 


26 
27 




^2 
^1 


^2 


^2 
*C2 


A2 


^ 

«2 


(W) 8 




«2 












(W) 


28 


«2 




*^ 


^2 












^8 














^7 




^8 


^8 






(Th) 9 




*A2 


Al 




^2 


*^2 




(Th) 


29 


*^2 








*^2 


*- 


(F)1C 

3 






^2 


^2 






8 


(F) 


30 


^2 


«2 






Al 




('01] 


L 






^2 


^2 






(M) 


31 






*A2 


Al 


^2 


^2 




I B2 






^2 








(T) 


32 






^2 


^2 


^1 
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TABLE 4 (continued) 







^10 


^10 


p 

''ll 


Si 


h2 


C, ^ 
12 


(W) 


13 












(Th) 


14 




^2 


^2 ' 


1 


A, 
1 


h 


(F) 


15 


\ 




*A2 


1 


B- 
2 


^2 


(M) 


16 




*Aj 


^2 


B^ 
2 


1 


*\ 






^13 ^13 




^4 


^15 


^15 


(T) 


17 


Al 


B 

1 




*C 

2 


^2 


«2 


(W) 


IS 


'2 




*Ai 


^2 


«1 


^1 


(Th) 


IS 


Cl 


*A2 




\ 






(F) 


2( 


) *Bj 


^2 


«2 


'2 







^10 ^10 ^11 Si ^12 ^12 



(W) 33|Aj Bj Cj A2 B2 

(Th) 34 



10 



(F) 35 
(M) 36 



B2 C2*Aj A2 B^ 
S Ai Bj C2 *B2 

*Bi " A2 B2 C2 *Ci Aj 



^3 S3 S4 S4 hs S5 



(T) 37 
(W) 38 
(Th) 
(F) 4C 



h S *^2 S B2 C2 j 
S *N ^2 '2 S *S I 



39 *B 



2 ^ S S *S ^2 



^2 «2 S*S N '1 



TABLE 4 (Continued) 
OBSERVATION CODING SCHEDULE 2: NINE OBSERVERS 



A = IBMS II A , A2, A3 
B = ICDS n n 

C = FLACCS 
* = IPPS 



Bj, B2, B3 
Cj, C2, C3 
(a.m. only) 



Block Day 

(M) 1 

(T) 2 

1 

(W) 3 

(Th) 4 



Pass 1--Kids 
1 2 3 4 5 6 



Pass 2— Kids 
7 8 9 Block Day 12 5 4 



5 6 7 8 9 



Aj Bj Ci|*B3 A2 B2f C2*C3 A3 

^2 S*S! ^2 ^3 S^Ai A3 Bj 
Aj Bj C2 
B2 C2*C3 



C3*A2 A3, B3 Ci*B2 
*A3 \ h\ S*^3 ^2 



(M)21 


1 

«3 VSl^S S 


t 

Sf^2 


Ai B2 


(T)22 


S*A3 


s s 


«3; ^2 


B2 C3 


(W)23 


*Aj A2 


B2I C2*Bi 


A3', B3 




(Th) 24 


A3 ^3 


Sr^2 Al 

1 

1 


s; S 


*S ^2 
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TABLE 4 (continued) 



13 



10 11 12 13 14 15 16 17 18 



10 11 12 13 14 15 16 17 IS 



(F) 5 ! B2 C2*C3, A2 Bi Cil^Aj A, B 
(M) 6 



(T) 7 
(W) 8 



^^2 S«3 '1 '2 



Ai Bi!Ci*B3 A2;B2 

A2 B2 C2S ^ '3;vs S 



(F) 25 Cj*A3 Aj, Bj C2*B3| A2 B2 C3 
(M) 26 *A, A, B j B^ a;_ C 

7 

(T) 27 
CW) 28 



S ^ \' '2 % \ ^ I 

A3 «3 s:*^ ^ ^; ^2 

^1 Aj B2 C2l*A3 A2 B3 



19 20 21 22 23 24 25 26 27 



19 20 21 22 23 24 25 26 27 



(Th) 9 
(F)10 

3 

C'l) 11 
(T)12 



C3*A2 A^ B3 Ci*B2,Ai Bj C2 
*A3 Ai C^*B3 A^' B^ C2*C3| 
A2 B2 C2:*Bi A3 83. C3*Cj Ai 
B3 C3*C2 A3 Bj Cj^A2 A, 82 



(Th) 29 l*A^ A^ B^, C2*Bi A^ 83 C^*C^^ 
(F) 30 A3 83 03^*82 Aj Bi| Ci*C2 

\ Cj*C^, Aj 82 C2l*A3 A2 8, 
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(M) 31 
(T) 32 



C2*Ai A2; B2 C3*8i^ A3 C3 



28 29 30 31 32 33 34 35 36 



28 29 30 31 32 33 34 35 36 



(W)13 


t 

*A3 Ai Bjl 0^*83 A^; 82 C2*C^ 


(Th)l4 


A2 B2 ^2*^1 A3 B3|VS Aj 


4 

(F)15 


B3 ^3*S N '1 'iK 


(M) 16 






37 38 39 40 41 42 43 44 45 


(T)17 


i 1 ' 

iA2 B2 S!*^^ B3. C3*Ci Ai 

1 



(W) 


33 


A3 


B3 


^3^ 


Al 


1 

^11 ^1* 


^2 


Ao 


(Th) 


34 






'^3', Ai 


B2 




A2 




9 

(F) 


35 


C *A, 
2 1 


A '8 
2| 2 


'3 




\ 




(M) 


36 


*A 

2 


A3 


8 ' C_ 
31 3 


*\ 


A? \ 
-1 




*C2 



37 38 39 40 41 42 43 44 45 



(W)18 

5 

(Th)19 
(F)20 



s ^ '1 'i:'2 ^ '2 

S*S \'i'i V3;^2 S S 

*Ai A2 B2',C2*Bi A3(B3 Z^*C^ 



(T) 37 

(W) 38 
10 

(Th) 39 
(F) 40 





^3' 


Al 


B2 


^21*^3 


A2 


B3 


C2*N 


A2' 
2| 


B. 


r *B ' A 
^3 "1 3 


^3 


C 

1 


*A2 A3 


B3I 




A,, \ 


^1^ 


^^2 






3 




A2 


^'l ^2 

1 
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Training Packages 

Because of the largo number of observers needed, the wide geographic 
distribution of the schools involved, and the number of systems used, it 
was necessary to develop efficient training packages for the observation 
2 

systems . 

• Under the direction of Melvyn I. Semmel, Acting Director of CITH, a 
special Project PRIt^E unit Was created. The Instructional Development 
Laboratory (IDL), coordinated by S. Thiagarajan, assumed responsibility 
for the training: components. Three production teams (one fbr each sys- 
tem) were then formed. A ClTH Project PRIME coordinator was appointed to 
work- with, the director, the authors of the observation systems, the in- 
structional development supervisor, and the production teams. This 
coordinator also worked blosely with BEH representatives, the Austin, 
Texas, PRIME office, and National Computer Systems (NCS), which printed 
and machine scored instruments used in the Project. (See Table 5, p. 15) 

A first step in the development of the training packages was the 
design of machine scorable coding booklets for each system. After de- 
signing and testing a series of possibilities, a final coding pattern 
was agreed upon. 

Included in each of these booklets, and common to all systems, is 
a 25 category system which records classroom data, in addition to the 
data specifically collected by each of the four observation systems. Hie 

^Training materials for the Florida Climate and Control Schedule were de- 
veloped at the Institute for Development of Human ^^^^'^^^^^ .^H^^^H^^ 
Education, University of Florida, and will not be discussed in this paper. 



TABLE 5 

ORGANIZATION OF THE CITH PROJECT PRIME UNIT 



Coordination> 
with 
Florida 

V FLACCS 

V Unit 



.Coordination \ 
I with \ 
I Texas / 
\ PRn4E ,/ 
. Office^ 



Melvyn I. Semrael 
Actin g Director of CITH 



Meredith Adler 
f^Qjrjjjiator, CI TH PRDffi Uni tl 

X ^ 

I J. Olson 
DRU _ 'JDL Coordinator^^! 



j'Xlfyersl ( sTThfagarajan 



TEL 



PRINTED MATERIALS 



AUDIO TAPES 



IBMS II 



Ted Frick 

Ted Hasselbring 

Anne Briggs 



Anne Briggs 



VIDEO TAPES 



CODING BOOKLETS 

and 
STATUS DATA 



Anne Briggs 
Ted Hasselbring 
Ted Frick 



ICDS 



S. Thiagarajan 
Ted Frick 



Chris Barger 
S. Thiagarajan 



Chris Barger 
Ted Frick 
Ted Hasselbring 
Anne Briggs 



S. Thiagarajan 
Anne Briggs 
Ted Frick 
Ted Hasselbring 



S. Thiagarajan 



2»i 



TABLE 5 



ORGANIZATION OF TOE CITH PROJECT PRIME UNIT 



Melvyn I, Semrael 
Acting Director of CITH 



ination 
ith 
exas 
RIME 
bffice^ 



Meredith Adler 
^oxdinatqr^CITHlEIML 

_ x 

">f)Fers\ rs.' Thfagarajan i 



UniJ 



IDL Coordinator. 



Olson 
TEL 




Coordination 
with I 



Washington 
PRIME 
Officer" 



1 


IBMS II 


! 

ICDS 


— i 

IPPS 


MATERIALS 


Ted Frick 

Ted Hasselbring 

Anne Brings 


S. Thiagarajan 
Ted Frick 


Chad Sivasailam 


PES 


Anne Briggs 


Chris Barger 
S. Thiagarajan 




PES j 


Anne Briggs 
Ted Hasselbring 
Ted Frick 


Chris Barger 
Ted Frick 
Ted Hasselbring 
Anne Briggs 


Chris Barger 
Ted Hasselbring 
Anne Briggs 
Ted Frick 
Chad Sivasailam 


OOKLETS 
I 

)ATA 


S. Thiagarajan 
Anne Briggs 

1 Ted Frick 

tl Ted Hasselbring 


S. Thiagarajan 


S. Thiagarajan 
Chad Sivasailam 
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Classroom Data Instruction Manual (Semmel & Hasselbring, 1971) was de- 
veloped to provide instructions on coding such classroom data. The man- 
ual lists ground rules, defines terminology, and gives examples of coding. 

TABLE 6 
CLASSROOM DATA CATEGORIES 

1. District code 

2. School code 

3. Teacher code 

4. Experimental pupil's I.D. 

5. Contrast pupil's I.D. 

6. Grade 

7. (For machine score use only) 

8. Date 

9. Select code 

10. Observer number 

11. Class size 

12. Type of class 

13. Classroom physical environment 

14. Personnel in class 

15. Displays in clasfroom 

16. Time started 

17. Activity 

18. Position of experimental and contrast children, teacher, and observer 
in the classroom 

19. Structure for classroom activities 

20. Teacher task 

ERLC 
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21. Pupil task 

22. Seating arrangement 

23. Time stopped 

24. Evaluation scale for 

25. Reliability 



TABLE 6 (continued) 



teacher, content, and ptrpils 



Initial preparation was begun for the development of the components 
of the training packages. On the basis of a systematic task analysis, 
the following competencies were found to be necessary for reliable 
coding. 

1. Identify the category to which a relevant behavior belongs. 

2. Make fine discriminations between neighboring categories. 

3. Code instantaneously while the behavior is occurring. 

4. Disregard irrelevant behavior in the classroom. 

5. Handle the recording device (e.g., coding booklet) efficiently. 

6. Code with confidence in the absence of any feedback about the 
accuracy of the coding. 

Each training package includes a programmed instruction manual, 
video tapes, audio tapes, a training manual which accompanies the audio- 
visual materials, and a self-instructional role-play unit consisting of 
an audio tape and four sets of role-playing cards which simulate a class- 
room setting. 
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TABLE 7 

CX)NTENTS: ICDS TRAINING KIT 



Item 



Contents 



Description 



Observer's Training Manual 

ICDS Training Booklet 

Coding Booklets 

Audio Tapes: 

Tape 1 Exercise 1 

Exercise 2 



Tape 2 Exercise 3 

Exercise 4 

Exercise 5 
Tape 3 Exercise 6 

Tape 4 Motlier Bear A 
Tape 5 Mother Dear B 



109 pages and 
Abridged Manual 



134 pages and 
64 pages con- 
finnation 



10 ninutes 



20 minutes 



30 minutes 

30 minutes 
30 minutes 



Programmed instruction 
book. Introduces cate- 
gories and coding rules. 

Instructions and feed- 
back for audiovisual 
materials . 

Recording device for 
coding status data, class- 
room data, and ICDS codes. 



Examples of categories 
with immediate feedback. 

Discrimination of spe- 
cific categories from 
choice of two demands, 
immediate feedback. 

Demand coding introducing 
use of coding booklets. 
Ten sets of five demands, 
feedback after each set. 

Five sets of ten demands 
with feedback after each 
set- 
Two sets of 25 demands, 
feedback after each set. 

Recognition and count of 
interchanges, interchanges 
identified in feedback. 



Counting of 
inter- 
changes . Con- 
firmation. 



Tapes A § B 
can be used 
together in 
different 
lengths of 
segments to 
suit individ- 
ual needs . 



ERLC 



TABLE 7 (continued) 
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Item 



Contents 



Description 



Tape 6 Mother Bear C 

Tape 7 Mother Bear D 
Tape 8 Mother Bear E 

Tape 9 Exercise 7 
Tape 10 Exercise 8 

Tape 11 Exercise 9 

Tape 12 Exercise 10 

Role-Playing Unit: 
Audio Role-Playing Tape 
and 4 Sets of Cards 



1. Practice Video Tape 
(3 segments) 

2. Practice Video Tape 
(3 segments) 

Criterion Video Tape 
(5 segments) 

Classroom Data Instruc- 
tion Manual 



Head Cleaning Kits 



30 minutes 

30 minutes 
30 minutes 

30 minutes 
30 minutes 

30 minutes 

30 minutes 
45 minutes 



30 minutes 
30 minutes 

30 minutes 

31 pages 



Coding both teacher demands 
and pupil responses. 

Coding feedback only. 

Coding teacher demand, pupil 
response, and feedback. 

Teacher demand, pupil re- 
sponse, and feedback in 
simulated classroom lessons. 

Teacher demand, pupil re- 
sponse and. feedback in 
simulated classroom lessons. 

Coding for the Experimental 
and Contrast children added. 

Same as above. 

Teacher cards, pupil cards, 
and number cards. Self-in- 
structional unit for simula- 
tion of classroom setting. 



cotton swabs, 
head cleaner 
for magnetic 
heads 



Lists ground rules, defines 
terminology, and gives ex- 
amples of coding system for 
collection of classroom data 
common to all systems. 

Materials and instructions 
for cleaning magnetic heads 
of audiovisual equipment. 
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TABLE 7 (continued) 



Item 



Contents 



Description 



Data collection sheets 

Data Collection Rules 
Observation Coding Rules 



Master Scoring Sheets 



120 

50 pages 
20 



Provides checklist of rules 
and procedures for coders to 
follow, including conduct, 
coding, and relay of data. 

Punched cardboard keys for 
facilitating rapid hand 
scoring of coding booklets. 



Pretest : 

Either : 
IBMS Pretest of Coder 

Ability 
Or: 

The Auditory Vigilance 
Test 



6 pages 



Test of category recall and 
application 

Audio tape and discrimination 
exercise of word clasi7ifica- 
tions occurring within the con- 
text of the tape. 
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TABLE 7 (Continued) 
CONTENTS: IBMS II TRAINING KIT 
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Item 



Contents 



Description 



Observer's Training Manual 147 pages and Programed instruction b^^^ 

Abridged Man- Introduces categories and 
ual coding rules. 



IBf4S Training Booklet 



Coding Booklets 



113 pages 



50 minutes 



Instructions for operation 
of vide 'J equipment and audio- 
visual materials. 

Recording device for coding 
status data, classroom data, 
and IBMS II codes. 



Video Tapes: 

1. Training Tape 
(13 segments) 



2. Practice Tape 
(7 segments) 

3. Criterion Tape 



1-hour tape, 
played twice 



1 hour 



30 minutes 



Simulated classroom lesson. 
Each segment shows one teach- 
er category and one pupil 
category. The pupil cate- 
gories are coded in the first 
run and the teacher cate- 
gories in the second run. 

Practice coding of IBMS II. 
Simulated classroom lessons. 

To be used as criterion mea- 
sure for IBMS coders. 



Audio Tapes: 

10 Second Beep Tapes 



Audio Supplement Tapes 
C4) 



1 hour 



30 minutes 



Beep occurs every 10 seconds 
on the entire tape. For use 
with practice tapes. Can be 
used alone for training coders' 
internal clocks. 

Used simultaneously with train- 
ing tape. Cues the trainee to 
code at the occirrrence of the 
beep. Training booklet pro- 
vides feedback on the category 
at the occurrence of the beep. 
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TABLE 7 (continued) 



Item 



Role^Playing Unit: 
Audio Role-Playing Tape 
and 4 Sets of Cards 



ClaiSroora Data Instruc- 
tion Manual 



Contents 



45 minutes 



31 pages 



Description 



Teacher cards, pupil cards, 
and number cards. Self-in- 
structional unit for simla- 
tion of classroom setting. 

Lists ground rule?, defines 
terminology, and gives ex- 
amples of coding system for 
collection of classroom data 
common to all systems. 



Data Collection Sheets 
Hea<?. Cleaning Kit 



Data Collection Rules 
Observation Coding Rules 



Master Scoring Keys 



120 

cotton sivabs, 
head cleaner 
for magnetic 
heads 

50 pages 



20 



Materials and instructions 
for cleaning magnetic heads 
of audiovisual equipment. 



Provides checklist of rules 
and procedures for coders to 
follow, including conduct, 
coding, and relay of data. 

Punched cardboard keys for 
facilitating rapid hand 
scoring of coding booklets. 



Pretest : 

Either; 
IBMS Pretest of Coder 
Ability 

Or: 

The Auditory Vigilance 
Test 



6 pages 



Test of category recall and 
application. 

Audio tape and discrimination 
exercise of word classifica- 
tions occurring within the con- 
text of the tape. 



TABLE 7 (Continued) 
CONTENTS: IPPS TRAINING KIT* 
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Item 



Contents 



Description 



Observer's Training Manual 47 pages 



Video Tape Sessions 
Booklet 

IPPS Training Tape 
(5 seginents) 

Coding Booklets 



30 minutes 



Programmed instruction book. 
Introduces categories and 
coding rules. 

Instructions for audiovisual 
materials. 

Coding of simulated classroom 
lesson from video tapes. 

Recording device for coding 
status data, classroom data, 
and IPPS codes. 



Data Collection Sheets 

Data Collection Rules 50 pages 

Observation Coding Rules 



Provides checklist of rules 
and procedures for coders to 
follow, including conduct, 
coding, and relay of data. 



Either: 
IBMS Pretest of Coder 
Ability 



6 pages 



Test of category recall and 
application. 



Or: 

The Auditory Vigilance 
Tei 



Audio tape and discrimination 
exercise of word classifica- 
tions occurring within the 
context of the tape. 



* For Project PRIME, materials for IPPS were combined with contents of 
individual kits for the other three syi^tems. 



5 J 



25 



TABLE 8 

SATURDAY VIDEO TAPING SQIEDULE 



October 30, 1971 - 8:30 a.m. to 12:30 p.m. 



8:30-9:00 


Equipment set-;ip and rehearsal 




for teachers 


9:00-12:00 


Tape IB!^ Practice Tape 




Evaluation 




Resources 




8 pupils--high school 




4-6 teachers 




video equipment 




production room- -TEL 




, ^ ... 

- S:30--a.m. to 12:30 p.m. 


8:30-9:00 


Equipment set-up and rehearsal 




for teachers 


9:00-12:00 


IBMS-'ICDS Criterion Tape 


1/ : Uu-i/ t 






Resources 




10-12 pupils — elementary 




4-6 teachers 




video equipment 




production room- -TEL 


iNovejnDer i^, ly/i 


- R'*^n m to 12'30 D.m. 


8:30-9:00 


Equipment set-up and rehearsal 




for teachers 


9:00-12:00 


I EMS Teacher Training Tape 


12:00-12:30 


Evaluation 




Resources 




10-12 pupils--elementary 




4-6 teachers 




video eqnip*.*ent 




production room- -TEL 
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TABLE 8 
SAMPLE VIDEO TAPING SOIEDULE 



IBNS Taping Schedule Saturday, November 13, 1972 8:30 a.m.- 



Time 1* 


Sroup 


Activity | Coordinator 


Teacher 


b^navxoio 


8:30-8:45 j all 

i 

1 

1 


1 

Organization: Group- 
ing, name tags, 
model tapes 


1 

Ted 1 
Anne j 


None 1 

t 
1 




8:45-8:55 


1 


Prepare segment 1 


Anne j 

i 


Judy 1 

i 


■h T 

t 1 






Tape segment 1 
Prepare segment 2 


Anne 
Ted 


1 

Judy 
Mona 


t T 

SI v*^ 


y : U5-y . 


2 
1 


Tape segment 2 
Pi^paro segment 3 


Ted 
Anne 


Mona 
Karin 


si CS 
n ^ 


9 : iD-y . ^3 


1 

X 

2 


Tape segment 3 
PreTDare segment 4 


Anne 
Ted 

* 


Karin 
Judy 


n D 
If-; VT 

VI V 


9:25-9:35 


2 
1 


Tape segment 4 
Prepare segment 5 


Ted 
Anne 


Judy 
Mona 


vi VL 
pi y^iJ 


9:35-9:45 


1 
2 


Tape segment 5 
Prepare segment 6 


Anne 
1 eu 


Mona 
Karin 


pi CD 
va 


9:45-9:55 


2 
1 


Tape segment 6 
Prepare segment 7 


1 Ted 
1 Anne 


Karin 
Judy 


va Q+ 
pa Q- 


9:55-10:05 


1 
2 


Tape segment 7 
Prepare segment 8 


Anne 
Ted 


Judy 
Mona 


! pa Q- 
' pr Pu 


10:05-10:15 


2 
1 


Tape segment 8 
Prepare segment 9 


1 Ted 
; Anne 


Mona 
! Karin 

1 


pr Pu 
vr I 
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TABLE 8 (continued) 



Time 


Group 


Activity 


Coordinator 


Teacher 


Behaviors 


10:15-10:45 j 


1 

all j BREAK! 


all 


all' 




f 

10:45-10:55 


1 
2 


Tape segment 9 
Prepare segment 10 


Anne 
Ted 


Karin 
Judy 


vr I 
* Pr 


10:55-11:05 


2 
1 


Tape segment 10 
Prepare segment 11 


Ted 
Anne 


Judy 
Mona 


* Pr 

* Es 


11:05-11:15 


1 
2 


Tape segment 11 
Prepare segment 12 


Anne 
Ted 


Mona 
Karin 


* Es 
va H 


11:15-11:25 


2 
i 


Tape segment 12 
Prepare segment 13 


Ted 
Anne 


Karin 
Judy 


va H 
* R 


11:25-11:35 


1 


Tape segment 13 


Anne 


Judy 




ll:35-Noon 


all 

1 

\ 


Watch tape 


all 


all 

1 


all 



Through the use of this technique, several 4-10 minute segments 
were produced for purposes of coding practice during the training of 
classroom observers. A set of tapes was kept aside to form one of the 
criterion tests for each package. 

The practice exercises involving these protocols are structured to 
approximate actual classroom events. Coding booklets are introduced 
from the very beginning to provide maximum practice. Trainees begin by 
watching (or listening to) small, isolated segments of classroom behavior, 
recording them in coding booklets, and getting immediate feedback from 
the training booklets. The segments gradually become longer, are mixed 
with more irrelevant behavior, require finer discriminations, and present 
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behaviors in faster succession. Feedback is delayed and later is com- 
pletely withdrawn. At this stage trainees are asked to compare their 
coding with one another and arrive at a concensus. 

Built into the training packages are small group activities and 
actual coding experiences. During the small group discussions, trainees 
play the roles of teachers, pupils, and coders. Apart from providing., 
a welcome change of pace, these sessions enable trainees to look at 
categories from different points of view. Classroom practices are kept 
close to actual observation procedures with one major exception. Pairs 
of trainees code during the same period which enables them to compare 
notes and reconcile their differences. 

Finally, all trainees are required to code- the same criterion tape 
twice through in order to gain an assessment of inter- and intra-coder 
agreement. On the basis of this assessment, a decision is made con- 
ceming whether a coder is adequately trained or needs further training. 

In producing the audio tapes, slightly different production tech- 
niques were used. These tapes involve both junior high and senior high 
pupils. The first technique utilizes scripts transcribed from actual 
classroom recordings; the second records spontaneous reactions to a pre- 
viously prepared teacher lesson. Scripts then had to be n^ade from the 
spontaneous lesson tapes in order to produce accurate confirmation cod- 
ing of each interchange. (See Table 9. p. 29) 

Audiovisual components of the training packages consist of 5 hours 
of video tape and 19 hours of audio tape. The ICDS. in which cues are 
primarily auditory, begins with audio tape exercises, then moves to 



TABLE 9 

PROJECT PRIME SAMPLE AUDIO TAPING SQiEDULE 
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The following schedule for audio taping of adult readers for the ICDS 
training program has been set up: 

Thursday, November 11th 10:00-12:00 Chris Barger 

Bill Ziimerman 
Karin fvtyers 
Meredith Adler 

10:00-12:00 Chris Barger 
Bruce Baum 
Renie Adams 
Karin Myers 
Meredith Adler 

1:00-3:00 Chris Barger 

Meredith Adler 
Karin I^ers 

Audio taping will be done at TEL. 

video tape segments. Since both IBMS II and IPPS depend heavily upon 
visual cues, more video tape work is included. 

Each segment of tape was coded at least twice by three expert 
coders. These coders prepared training manuals which contain directions 
for use, maintenance, and simple repair of audiovisual equipment. 

All video tapes and most audio tapes were made at the Teacher Educa- 
tion Laboratory (TEL) at CITH. The remaining audio tapes were recorded 
at the Indiana University Language Laboratory, whose facilities were 
also used for editing and duplicating tapes. Video tapes were duplicated 
at the University School Closed Circuit Television Studio. 

As both written and audiovisual parts of the program progressed, 
a developmental testing program provided feedback to members of produc- 
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tion teams. In the earlier stages, evaluation proceeded on a chapter by 
chapter and segment by segment schedule, with constant revision for im- 
provement o£ materials. Later, as groups of subjects tested the integrated 
packages, their feedback served as the basis for further strengthening 
the program. 

Pretests of Coder Ability 

Of major concern to those who were working with the training pack- 
ages was a measure for prediction of coder ability. Consequently, con- 
current to production of the training packages, two pretests were de- 
veloped at CITH. The IBMS Pretest of . Coder Ability (Frick, 1971) al- 
Icvvs 10 minutes for reading descriptions of and memorizing ten cate- 
gories. Subjects are then tested for recall of names and abbrevia- 
tions of the categories, and are asked to code a short transcript of 
classtooin behavior. 

The second test is a measure of Auditory Vigilance (D. Semmel, 1971). 
While subjects listen to an audio tape, they are asked to tally all words 
that belong in the classifications of (a) geographic place names, (h) 
animals, (c) bodies of water, or (d) numbers. Directions are given on 
the tape, instructing the listeners to code two 3-minute segments on the 
special tally sheets provided. 

One of these pretests was administered to each of the trainees in 
the Texas workshops. Analysis of this data is in progress. 

Packaging the Training Kits 
Special kits were designed to meet the demands of the training 
packages as used in workshop situations. The demands include the need 
to: 
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!• Compactly store a large volume of print and audiovisual 
materials, data collection sheets, coder checklists, 
pretests, head cleaning kits, and master scoring keys. 

2. Provide compartmentalization so that the trainer will 
have instant access to materials needed. 

3. Be easily portable. 

After investigation of several possibilities, and following meet- 
ings with representatives of packaging firms, a compartmentalized canvas 
bag was decided i^on and ordered. A decal identifying the system material 
contained in each bag was designed at CITH. Ten IBMS II-IPPS kits and 
ten ICDS'IPPS kits were prepared. 

A serious problem was presented by the fact that the Texas Training 
Team would be traveling and transporting materials by air. Magnetic 
force field equipment, which has been installed at most airports to aid 
in detecting hijackers, may erase video and audio tapes. After con- 
ferences with airline officials, careful instructions were prepared for 
team members. Each person carried his kit onto the plane as hand lug- 
gage. During check-in procedure he identified the contents of his kit 
OTd requested that it be passed around and not through the force field. 
In order for the kits to be exempted from the usual routine, it was neces- 
sary that the kits be searched by airline personnel. 

Training Workshops 
The core of the Texas Training Team (TTT), which conducted work- 
shops in 17 Regional Service Centers throughout the state, consisted of 
19 University of Te/.as graduate students. These students were enrolled 
in a graduate course in the study of observation systems. They were 
admitted to the course after interviews which attempted to assess both 
their potential as coders and as trainers, and their understanding of and 
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interest in the project. Both CITH and Austin PRIME personnel participated 
in these interviews. 

Thirteen of the students attended a five day intensive workshop 
which was held January 9-14, 1972, at CITH. Of these, seven learned ICDS 
and the other six, IBMS II. The remaining students attended a workshop 
for FLACCS at the University of Florida. Since all 19 also learned IPPS, 
a CITH trainer went to Florida to instruct those students in that system. 

TABLE 10 

TEXAS TRAINING TEAM (UNIVERSITY OF TEXAS STUDENTS) 
JANUARY 9-14, 1972 



Center for Innovation in Teaching the Handicapped University of Florida 



ICDS--IPPS 


IBHS II--IPPS 


FLACCS— IPPS* 


Martha Bates 


Mitzi Chambers 


Barbara Balfour 


Linda Bishop' 


Vicki Gomez 


Carlos Gris 


Nancy Fanning 


Johanna Hulls 


Karen Litton 


Margaret Gamer 


JoAnn Miller 


Linda Sheets 


Manuel Mirabal 


Linda White 


Kent Skipper 


Steve Selby 


Phyllis Winford 


Jeanette Wendt 


John Stammer 







* Chad Sivasailam and Robert Zuckerman of CITH also attended the FLACCS 
\vorkshop. 



The week before the Team trained at Indiana, a systems workshop was 
held. During this PRIME Preview, the director and trainers held daily 
meetings to work out final details in scheduling, use of facilities, and 

ERIC 
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methods of individualizing the program to provide assistance for trainees 
who might have difficulty with a particular aspect of the program. 

Due to a delay in receiving the printed materials, the CITH staff 
had to duplicate the manuals from the original manuscripts and collate 
and bind them. By the time of the TTT workshop, print materials had ar- 
rived; however, considerable collation was needed to convert them to 
final usable form. 

In the Training Team Workshop, students not only learned the observa- 
tion systems, but received intensive training in the organization of 
workshops, group dynamics, methods of individualizing instruction, use 
of materials and equipment, and collection of data. 

On the first day of the i/orkshop, trainees were introduced to 
the Classroom Data Instruction Manual and to the coding booklets- They 
then completed the written and video portions of IPPS. In the late 
afternoon, trainees spent an hour and a half coding in an actual class- 
room. Afterward, students gained additional experience by coding 
simulations. 

Students began learning their second system the next day. The 
material in the written program was interspersed with audiovisual seg- 
ments illustrating each of the categories. Throughout the workshop 
criterion tests were given, followed by feedback and discussion. Stu- 
dents coded in the schools both Thursday afternoon and Friday morning. 
(See Table 11, p. 34) 

Finally, each trainee received detailed instructions on phases of 
data collection: (a) how to gather and transmit coder reliability data 
from criterion tests, using specially designed data collection forms, 
and (b) how to instruct coders to collect and forward data. 
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TABLE 11 

TEXAS TRAINING TEAT^ WORKSHOP JANUARY 9-14, 1972 

Center for Innovation in Teaching the Handicapped, Indiana Universit- 

Sunday, January 9: Arrival from Texas, 7 Reception at the home of 

CITH Acting Director, Melvyn I. Semmel, 9 p.m. 




IBMS irr Written 
Program, Pupil 
Behavior plus 
Chapters 21 q 22 



jTape; Pupil 
iBehavior at 
TEL 




ID H 
0) OS 



I CDS: Introduc- 
tion;Read Observ- 
er's- Training Man 
ual Chapters 1-11 



Discussion; 
Read Chap- 
ters 12-16 



Finish Train- 
ing Tape Part 
I, TEL; Finish 
Written Program 



Teadier Be- 
havior, Cottage 
K 



Chapter 17; 
Discussion 



Audio Tape 
Exercises #1, 
2, 3, 4, 5 



I/) 

! <o 



IBMS II: Quick 
Test on Cate- 
gories; Finish 
Training Tape, 
Teacher Behavior 



ICDS: Test and 
Review; Audio 
Tape:Ex. #6, 
Mother Bear A 
§ B 



IBMS Role 
Playing 



Practice tape 
in TEL 



; Continue Prac- 
Itice Tape 



(/) 



IBMS II: Crite- 
rion Tape Trial 
I at TEL;Discus- 
5ion;Good Coders 
and Good Trainers 



Discussion; 
Mother Bear 
C, D, E 



Exercise #7 



Rdle Playing; 
Exercise ffU 



Continue 
[Discussion; 
'VTR Practice 



ICDSrTest and Re- 
view; Video 
Practice Tapes 
#2, 3, 4, 5, 6 



Classroom 
Coding in 
Schools 



Classroom Simu- 
lation at TEL 



Criterion 
jTape 1 



Procedures 
for Enter- 
ling; Class- 
iroom Coding 



Code Classroom 
Simulation, take 
turns teaching 
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TABLE 11 (continued) 





8:00-10:00 a.m. 


10:00-12:00 p.m. 


1:00-3:00 p.m. 


3:00-5:00 p.m 


•» 1-4 


IB^B II: Crite- 
rion Tape Trial 2 
at TEL; Classrocsn 
Coding in Schools 


Continue class- 
room Coding; Dis- 
cussion at TEL 


Farewell 

r 


Ride to 
Indianapolis 
to board 
plane 


Frida) 
January 


ICDS: Question 
and Answer; Code 
Criterion Tape 
II 


Score Crite- 
rion Coding 
Sheets 


1 

Final Prepara- 
tion for Texas 
Training 

I 






! ' - 1 



Additional evening instruction was made available to those 
trainees desiring it. 
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ICDS CODER DATA COLLECTION SHEET 
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Trainer Number: Date: 
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Code Sheet # w 

ICDS CODER DATA COLLECTION SHEET 



he: District Number: 

[iber; Date: 

^er: C.T. Administration Nuniber: 



BEHAVIOR CATEGORIES 
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PUPIL BEHAVIOR CATEGORIES 
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Trainer Name: 
Trainer Number: 
Region Number: 



TABLE 12 (Continued) 
IPPS CODER DA.TA. COLLECTION SHEET 



District Number; 
Date: 



C.T. Administration Number: 



Coder 
Name 
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11 



12 



13 



14 



15 
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TABLE 12 (Continued) 
IPPS CODER DATA COLLECTION SHEET 



District Number: 
Date: 



Code Sheet # 



C.T. Administration Number: 
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TABLE 12 (Continued) 

IPPS CODER DATA COLLECTION SHEET 

Trainer Name: District Number: • 

Trainer Number: Date: ^ ^ ^_ 

Region Nuiribeir: C.T. Administration Number,: 



TABLE 12 (Continued) 
IBMS II CODER DATA COLLECTION SHEET 
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TABLE 12 (Continued) 
IBMS II CODER DATA COLLECTION SHEET 



District Number; 
Date: 



Code Sheet # 



C.T. Administration Number: 



PUPiL BEHAVIOR CATEUURitb 
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As the Workshop progressed, the individual trainees became a closely 
knit team. Evidence of the team spirit became more apparent throughout 
the week as the trainees participated in discussion groups and provided 
help and encouragement to the others in the group. All of the staff 
took part in efforts to welcome the Texas Team. 

At the end of the Workshop, each member of the team was given a kit 
containing all of the materials necessary for conducting a workshop in 
IPPS and one of the other systems (i.e.. ICDS or IBMS) . To symbolize 
graduation from the workshop, a special ceremony was held in which every 
trainee was presented with a formal CITH diploma designating him a 
"Master of Observation." On Friday evening. January 14. all Texas Train- 
ers, both those at Indiana and those at Florida, returned to Austin. 

Observation Workshops in Texas 
From January 17 to February 3. 1972. the Training Team, augmented 
by eight trainers from CITO. held observation workshops at 17 Regional 
service Centers throughout Texas. Five hundred and twenty-eight ob- 
servers were trained. Trainers rotated weekly, so that each of the three 
.ajor systems was taught at each Center. In addition, all trainers pro- 
vided instruction on the IPPS. 

TABLE 13 

TRAINERS IN OBSERVATION SYSTHIS WORKSHOPS IN TEXAS 
January 17-February 3, 1972 





Week 1 


IVeek 2 i Week 3 


Region 

T 1 n-rc^An 


, Manual Mirabal 


Karen Litton 


Phyllis Winford 


X. wc^w^w J 

II Corpus Chris ti ' Kent Skipper 


: Jo Ann Miller 


Linda Bishop 



•19 
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Region 


Week 1 


Week 2 


Week 3 


III. Victoria £ 


iarbara Balfour J 


fohn Stammer L 


inda White 


IV. Houston 1 

^ 


red Frick (CITH)j( 
4itzi Chambers 1 


:arlos Gris S 
feannette 
Wendt 


. Thiagarajan (CITH) 
orje Carrasco* 


i 

V. Beaumont 




Johanna Hulls S 

c 


;teve Bury* 
Jandra Harrison 
fAustin PRI^iE Staff) 


r 

VII. Kilgore | 


J eanne txc 
Wendt 






VIII. Mt. Pleasant i 

1 


John Stammer 


Phyllis Win- 
ford 


Joan Zinober 
(Washington PRIME 
staff) 


X. Richardson \ 


Lnau Divasai 1- 

am (CITH) 
Linda Sheets 


Manual 

Hirabal 
S. Thiaga- 

raian (CITH) 


Mitzi Chambers 

r — 


XI. Ft. Worth 


«-»■*• 1 e tXir'X C 
Lan03 


Vicki Gomez 


Mona Ballard (CITH) 


XII. Waco 


S. Thiagara- 
J an 

1 Nancy Fanning 
Linda Bishop^ 


I 

tinda Sheets 
Joan Zinober 
(Washington 
PRIME staff) 


Anne Briggs (CITH) 
Nancy Derryberry* 


XIII. Austin 


Phyllis Winford 


Barbara Bal- 
four 


Steve Selby 
Mari^aret Garner 


XIV. Abilene 


Martha Bates 


Linda White 


Robert Zuckerman 

-4-^ 


XV. San .^ngelo 


Johanna Hulls 


Kent Skipper 


John Stammer 


XVI. Amarillo 


! 

Karen Litton i Margaret Gar- 
1 ! ner 


Julia Mendina* 


XVII. Lubbock 


i 

1 Margaret Garner 


Mitzi Chambers 


5 Karen Litton 


XVIII. Midland 


1 Vicki Gomez 

1 


Mona Ballard 
1 fCITH) 


Kent Skipper 
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TABLE 13 (continued) 



Region 

XX. San Antonio 



Week 1 

Ted Hasselbring 
(CITH) 

Idajean Windell 

(CITH) 

Linda IVhite 



Week 2 

Martha Bates 
Linda Bishop 
Steve Selby 



Week 3 

Barbara Balfour 
Linda Sheets 



* Outstanding observers who had been trained in earlier workshops were 
used as aides and trainers during V/eek III. 



Week 4: A make-up Workshop was held in San Antonio (XX.) in which five 
IBMS II observers were trained. Mitzi Chambers conducted the 
Workshop . 



TABLE 13 (Continued) 
CITII PERSONNEL WHO CONDUCTED WORKSHOPS IN TEXAS 



Week 1 


Week 2 


1 '.'leek 3 

! 


Ted Frick 


Mona Ballard 


! Mona Ballard 


Chad Sivasailam 


S. Thiagarajan 


; S. Thiagarajan 

1 


Ted Hasselbring 




1 Bob Zuckerman 


Idajean Windell 




1 Anne Briggs 

i 


S. Thiagarajan 







In preparation for the workshops, CITH personnel met with the directors 
of the Regional Service Centers in Texas and helped work out problems con- 
cerning facilities and equipment for the sessions. This was followed by 
frequent communication with centers that were having difficulty adapting 
or procuring equipment. For those that were unable to secure equipment, 
CITli transported necessary hardware to Texas for the training. 

Since CITH has also worked closely with National Computer Systems, 
Inc., who printed PRIME coding booklets and training materials, our person- 
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nel supervised both transportation of this software from Minneapolis by 
accompanying the shipment, and distribution of these training and coding 
supplies to the Service Centers. 

On Saturday, January 15, a meeting of the TTT, Austin staff, and 
CITH trainers who were to conduct workshops was held. Because the CITH 
members were those who had worked in the development of the training 
packages, and also had experience in conducting workshops, arrangCEents 
were made for them to serve as "troubleshooters" for any training prob^ • 
lems. The CITH Project PRIfffi coordinator, who was assigned to the Austin 
office during the workshops, served as liaison in meeting such needs 
as they arose. 

The next day, an impromptu distribution depot was set up in the 
Austin airport. Six VTRs, three monitors, two audio recorders, and 79 
cartons each weighing approximately 70 pounds, were sorted and dis- 
tributed to individual trainers who were leaving for the first series of 
workshops. Since the nmnber of trainees varied from 2-24 per week, it 
was essential that proper quantities of each of the printed materials 
reach the individual workshops. Distribution began at 8 a.m. and was 
completed by 6 p.m. That evening, trainers phoned the Austin office 
"hot line," manned by the CITH coordinator, to report arrivals, addition- 
al needs, or basic training problems. By 2 a.m. all trainers had 
reported. 

The weekend follcwing the first workshops, January 22 and 23, all 
trainers gathered at Broivnsville, Texas, for discussion of training and 
workshop procedures. Present for the meeting were Austin staff, the 
CITH coordinator, Drs. Semmel, Kaufman, and Soar. 
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While the Texas workshops were in progress, the Austin office per- 
formed a number of functions vital to the Project. Because actual observa- 
tion in the schools was due to begin on Monday following Week I workshops, 
the first order of priority was completion of individualized observation 
schedules, based on the CITO model, for each school district. Extra help 
was hired to handle this detailed and exacting task. Next, additional 
materials essential to observations were prepared and mailed to individual 
schools and to special education supervisors. These included overviews 
of the project, payroll worksheets, mailing labels, and envelopes for 
data collection. 

The Cim coordinator dispatched additional training materials as 
needed. mar.ned the "hot line," aided in travel and assignment of trainers 
for workshops, and coordinated data collection and payroll, both of which 
were being handled by CITH at Bloomington. Additional time was spent 
helping the Austin staff work out problems of special education directors, 
principals, and observers.. 

In Bloomington, the CITO administrative assistant spent the month 
dealing with the extremely involved accounting procedures of the project. 
These included not only TTT honoraria and travel expenses, but also the 

collection of payment and of personal and travel information required for 

reimbursement of approximately 200 trainees per week. 

Quality Control 

The procedure for maintaining quality control checks on more than 500 
observer trainees attending the workshops was developed by the staff of 
the Teacher Education Laboratory (TEL) at CITH. It utilized resources of 
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TEL. the Indiana University Research Computing Center (RCC) , and the 

Washington office of BEH. 

Following criterion test administration on each Monday and Thurs- 
day. the.BEK offices phoned trainers in each of the regions. Data was 
transmitted by phone and recorded on summary data sheets, which were 
sent by Xerox telecopier from Washington to TEL in Bloomington. At 
approximately 6:30 p.m.. a team of CITH keypunchers left TEL for the 
RCC with the first groups of data. As additional data arrived, it was 
sent by runner to the RCC. An average of six keypunchers worked from 
4-6 hours per night preparing the data for computer analysis. 

Next, the data was submitted to the RCC computer. Results were 
taken from the Computer Center to TEL for further analysis by the staff. 
Reliability data with individual comments on the strengths and weak- 
nesses of each trainee was then transmitted by telecopier back to 
Washington. Washington relayed this information to trainers in Texas. 

con5)leting the cycle. 

Trainers received the information on criterion testing within 12 
hours of test administration, enabling them to analyze realistically 
the progress of their trainees and thus provide appropriate guidance 
for those i,;ith specific problem areas. (See Table 14, p. 46) 

Assessment of Reliability 
During developmental testing, the PRIME Preview, and the TTT 
Workshop. Guilford's Intra Class Correlation Coefficient Cl%5.) was 
used in analysis of data. While this measure provided reliability 
estimates of each category, it did not allow for assessment of individual 
coders. Furthermore, analysis using this coefficient required more 



TABLE 14 



OBSERVATION SYSTEMS WORKSHOPS IN TEXAS 
January 17-February 3, 1972 



Region I Laredo (13) 



Location 



Region II Corpus Christi 

(27) 



Region III Victoria (30) 



Region IV Houston (63) 



{Region V Beaumont (16) 



Region VII Kilgore (2) 



Week 1 



No. of 
trainees 



Region VIII Mt. Pleasant (25) 



11 



10 



21 



Region X Richardson (41) 13 



] failed 
Systems i criterion 



Week 2 



ICDS 



IPPS 



FLACCS 



i IPPS 



FrJVCCS 



IPPS 



IBMS II 



IPPS 



ICDS 



IPPS 



1 FLACCS 



IPPS 



ICDS 



IPPS 



FLACCS 



IPPS 



No. of 
trainees 



Systems 



failed 
criterion 



FLACCS* 



IPPS 



IBMS II 



1 IPPS 



10 



22 



13 



()[| FLACCS has no criterion test. 



ICDS 



IPPS 



FLACCS 



IPPS 



IBMS II 



IPPS 



IBMS II 



IPPS 



ICDS 



IPPS 
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Wee 

^^o. of 
trainees 


k 1 
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vet ems Ic 
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Week 
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trainees ^ 
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failed 1 
Systems criterion " 


Week 
^0. of 
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Systems 
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criterion 
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rrns ^ 


4 1 


FLACCS* 1 


1 


5 'IBMS II '; 








IPPS ! 
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1 
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I CDS 
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IPPS 
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PT.Arrs 




10 


I CDS 


2 


10 
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i IPPS 
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IPPS 
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IPPS 


3 1 

1 




21 '; 


IBMS II 




22 


FLACCS 1 


20 
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2 




IPPS 


2 




IPPS j 




ilPPS 

1 


2 
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— ' 

I CDS 
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IBMS II 
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lIPPS 
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IPPS 
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i 




(25) 
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1 

I CDS 


3 
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IBMS II 
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8 


1 FLACCS 


. — 1 


IPPS 


3 




IPPS 


1 


i ' 1 


:41) 


13 
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FLACCS 




i 13 


I CDS 
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! 2 

-i 


-i 1^ 


ilBMS II 
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-( 
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TABLE 14 (continued) 



Location ^ 


We 

^0. of 
trainees 


ek 1 1 
{ failed i 
Systems 1 criterion , 

! i 


WeeTc 
No. of 

xr amees 


2 

Systems j< 

— i- 


failed 
:riterion 


1 ^ 

Region XI Ft. Worth ' ^ 

• 

1 : 


FLACCS 




13 


IBMS II i '* -1 


IPPS 




IPPS 


i \ 


Region XII Waco (71) | 24 


I CDS 


3 


23 


FLACCS 




IPPS 


7 


IPPS 


10 


1 \ r 

'Region XIII Austin (19) 7 

t i 


IBMS II 




6 


FLACCS 




IPPS 




IPPS 




— r 

i 

Region XIV Abilene Co) | 

i 
1 


1 


I CDS 




2 


IBMS II 




IPPS 




IPPS 




Region XV San Angelo (36) 


12 


1 

IBMS II 


1 


12 


FLACCS 




IPPS 




IPPS 




Region XVI Amarillo (6) 


2 


FLACCS 




2 


I CDS 




IPPS 




IPPS 




Region XVII Lubbock (33) 


11 


i 

1 Trnt; 




10 


I BUS II 


1 


IPPS 




IPPS 


1 


Region XVIII Midland (30) 


10 


IBMS II 




10 


I CDS 




IPPS 
\ 


1 


IPPS 




Region XX San Antonio (73] 


23 


' IBMS II 


2 


24 


I CDS 


4 


1 IPPS 


1 


IPPS 
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i . — ^ " — . Ul^^l' 


Week 3 


j We( 
(No. of 
i trainees 


sk 1 1 
j failed j 
Systems 1 criterion 

! i 


No. of 
trainees 


1 failed 
Systems 'criterion 

. \ 


No of ' 
trainees 1 


failed 
Systems crite- 
rion 


— ^ L 

7) j 9 

i ■ 


! i 

cT.Arrs 1 


13 


IBMS II ! 4 1 


15 ' 

1 


ICDS 2 


IPPS 




IPPS 




1 

1 

r 


IPPS 2 


. t 1" 

'• 24 

I 

\ 


I CDS 


3 


23 


FIACCS 


1 


24 


IBMS 6 


IPPS 


7 


IPPS 


10 ! 

I 


1 


IPPS 5 


— ^ ^ 


IBMS II 




6 


FLACCS 




6 i 

t 

1 


ICDS 


IPPS j 


i 


IPPS 




IPPS 


— ! ' 

^ i 2 
i 


1 

Trnq ! 


2 


IBMS II 






FLACCS 


IPPS 




IPPS 




IPPS 

■ — 


!■ 

:36) 


12 


IBMS II 


1 


12 


FLACCS ! 


JL 


ICDS 2 
' IPPS 2 


, IPPS 

1 




IPPS 








2 


PT.Arrs 




2 


I CDS 




2 


\ IBMS II 


j IPPS j 


IPPS 




1 IPPS 

1 i 
1 ' 




11 


! I CDS 




10 


I BUS II 


1 


12 


■ FLACCS 


IPPS 




IPPS 


1 


IPPS j 




10 


IBMS II 




10 


I CDS 




10 


FLACCS 


IPPS 


1 


IPPS 






j IPPS 1 

-! ■ 


(73] 


23 


-j 

' IBMS II 


2 


24 

1 ... .. . 


I CDS 


4 


26 


! FLACCS 


' IPPS 


1 


IPPS 


4 


I IPPS 13 * 

r/'O" ■ ----- - 


■ • .?■:» 
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TABLE 14 (continued) 



Total Trained 



Total Failing Criterion 



IPPS 



528 



81 



IBMS 



174 



11 • 



ICDS 



176 



20 



FUCCS 



178 



time than could be allotted if rapid feedback were to be provided to 
large numbers of trainees. 

For the purpose of feedback to these trainees, a modified version of 
Scott's Coefficient (1955) was utilized. The modification affected the 
means by which percent agreement was calculated. This change was recom- 
mended by Collet (University of Michigan), Otherwise Scott's formula was 
unaltered. Olson wrote a computer program to facilitate the processing 
of the large amount of data in a very short period of time. Each print- 
out provided a rank ordering of trainees from each region on the basis 
of percent agr^^ement and Scott's Index. This was done for both intra- 
coder agreement and inter-coder agreement, with a set of criterion scores 
for each observation system. 

Although Scott's Coefficient has been widely used by people such as 
Flanders, it has often been criticized in the literature. Due to time 
pressure and problems of programming more robust coder reliability 
measures, it was decided that Scott's Coefficient would provide the most 
easily understandable and manageable feedback to trainers and trainees. 
More rigorous and robust statistical measures of reliability are now being 
applied to the data for a more sophisticated assessment. The reliability 
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data analysis will be reported in a forthcoming progress report. 

Continuing Activities 
Classroom observers collected data in the classrooms throughout the 
State o£ Texas. At the end of each week, district special education 
directors mailed completed coding booklets to the Austin PRIME office. 
Trained screening personnel reviewed each coding booklet, checking it 
for internal consistency, errors of omission, and sloppy coding. These 
errors were recorded, and corrective feedback was immediately communicated 

to coders in the field. 

In addition, an observer maintenance check was scheduled to monitor 
coder reliability. These procedures and results will appear in a forth- 
coming report (Frick § Semmel, in preparation). 

All observation data has been collected and sent to NCS, where the 
coding booklets are being machine scored and the data are being trans- 
ferred to computer tape and prepared for data analysis. 
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In addition, an observer maintenance check was scheduled to monitor 
coder reliability. These procedures and results will appear in a forth- 
coming report (Frick § Semmel, in preparation). 

All observation data has been collected and sent to NCS, where the 
coding booklets are being machine scored and the data are being trans- 
ferred to computer tape and prepared for data analysis. 
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Time Records of 
CITH Personnel: Project PRIME 



September 1971 to Januaiy 1972 



Name 


Tasks 


Time 


Melvyn I. Semmel 


Acting Director, CITH 
Supervision of Project 


50% of 
total time 


Albert H. Fink 


Meetings, analysis, and 
consultation 


100 hrs. 


William Lynch 


Meetings, analysis, 
consultation and confir- 
mation coding 


150 hrs. 


Carole Ames 


Meetings, analysis, 
consultation and confir- 
mation coding 


150 hrs. 


Karin Myers 


Meetings, analysis, 
consultation, confir- 
mation coding 


40 hrs. 


Data Collection and 
analysis 


40 hrs. 


Kenry Goodstein 


Consultation concerning 
testing materials 


16 hrs. 
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Clerical 



Project PRIME Secretary - Cherry Heffeman 



October 1 

November 1 - Jantiary 3 



120 hours 
360 hours 



Coordination of all clerical work in Project PRIME; typing final drafts 
for IBMS II Observer Training Manual, IBr4S II Training Booklet, Classroom 
Data Instruction Manual, IPPS Observer Training Manual, IPPS Training 
Booklet, and IBMS Pretest of Coder Ability, ICDS Observer Training 
Manual, and ICBS Training Booklet; duplication ana collation all 
materials for developmental testing; packaging materials PJ^^^ ^^6^' 
travel arrangements for CITH personnel working on Project PRIME. 



CITH Staff 

November - December Barbara Senden 

Typing and revisions of ICDS Materials 

November - December Marge Williams 

Typing typescripts, labels, and manuscripts 

LuAnn Moore 
Typing revisions of IBMS II 

Jane Arata 
Typing revisions of IBMS II 



Miscellaneous Clerical 



Artwork 



Judy Lack 
Judy Lank ford 
Lynn Shoff 

Renie Adams 



215 hours 
102^^ hours 
200 hours 
8 hours 



11 hours 
11 hours 
4 hours 

20 hours 



TV J 
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Technical 



Audio Taping 

Video Taping 

October - November 
January 



October - November 



October - November 



Tracy Callaway (also clerical) 
Hugo Sandoval 



Ron Melvin 

Setting up technical equip- 
ment; camera and sound work 
Transportation and delivery 
of equipment for audiovisual 
equipment used in Texas 



Tom Coffman 

Camera and technical 

assistance 

Barry Gillespie 
Camera and technic2'' 
assistance 

Jerry Olson 

Supervision, camera and 
technical assistance for 
audio and video taping 



232 hours 



30 hours 
6 hours 



36 hours 



25 hours 



10 hours 



100 hours 
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Reliability Analysis 
December, 1971 - January, 1972 



Supervision 



Analysis, 
January 17 
Februar>' 



Keypunch 



Runner and Keypunch 



Bill Shaffer 
Dennis Boerger 
Nick St ay rook 



Melvyn 1= Semmel 
Jerry Olson 
Dennis Boerger 
Bill Shaffer 
Nick St ay rook 
rdajean V/indell 



Karin Myers 
Bruce Baum 
Vicki Bridge 
Judy Dibble 
Candy Garrett 
Cherry Heffeman 
Judy Lack 
Roger Newman 
Kay Olson 
Dorothy Seininel 
Lynn Shoff 
Linda Tillman 
Barry Gillespie 



48 hours 
36 hours 
24 hours 



Total 108 hours 



48 hours 
48 hours 
48 hours 
48 hours 
48 hours 
36 hours 



Total 276 hours 



48 hours 
12* hours 
12 hours 
12 hours 
12 hours 
36 hours 
12 hours 
12 hours 
12 hours 
12 hours 
12 hours 
12 hours 
26 hours 



Total 230 hours 



Ted Frick 



August 23 - 
September 29 

September 



October 5 - 
December 15 



November 1-21 



December 20 
January 9 



October - 
January 

December 10 
January 3 



Jaruar ' 3-7 



IBMS I First draft, writing, 
content edit.ing, consultation 

IBHS I Video tape production, 
planning, taping session^, 
criterion coding 

IBr!S II first and second 
drafts, writing, content 
editing, and consultation 

imS II Video tape production, 
planning, taping sessions, 
criterion coding 

IBMS Pretest, planning, 
vrriting first and second 
drafts, developmental testing, 
data analysis 

Conferences on PRIME develop- 
ment 

Conferences on system revision 
and editing 

Editing of paper and pencil 
program 

Developmental testing 

Preparation for training 

PRim Preview workshop 
preparation 

Preview workshop training 
Data analysis 



180 hours 



36 hours 



190 hours 



52 hours 



19 hours 
50 hours 

7 hours 

32 hours 

8 hours 
40 hours 

40 hours 
40 hours 
12 hours 



Total 706 hours 
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Ted Hasselbring 



September 3-10 

September 20 - 
October 8 

October 18-22 

October 18 - 
November 5 

November 8 - 
December 3 



December 13-17 



December 27-31 



January 3-7 



Planning, video tape production 

Confirmation coding, tape 
editing, developmental testing 

Revisions 

Planning third set of video 
tapes, revisions 

Confirmation coding and 
development of IBMS 11 
Training Booklet 

Conferences, planning and • 
i^riting of Classroom Data 
Instruction Manual 

Planning and scheduling 
for training 

Preview workshop planning 
and meetings, training of 
CITH personnel 



80 hours 

115 hours 
40 hours 

120 hours 

160 hours 

45 hours 
40 hours 

70 hours 



Total 670 hours 



Anne Briggs 



August 2-6 
August 9-13 

August 16 - 20 



August 23 - 
September 4 



September 6-17 



September 20 
October 8 

October ,11 - 
Noveiabet 



November 8 - 
December 3 



December 6-24 



December 27 - 31 



January 3-7 



Tape production 

Tape production and 
confirmation coding 

Confirmation coding and . 
program planning 

Program planning, analysis 
of teaching task and plaiining 
tapes 

Planning and production of 
second set of video tapes 

Confirmation coding and 
developmental testing 

Revision and reorganization, 
planning third set of video 
tapes 

Confirmation coding and 
development of IB^TS II 
Training Booklet 

Final revision and training 
of IBMS II and collating 
of ICDS 

Production of model tape, 
role-playing tape and re- 
vision of Abridged Coder's 
Manual 

General planning conferences 



30 hours 
30 hours 
35 hours 

60 hours 
60 hours 
95 hours 

120 hours 

155 hours 

95 hours 



30 hours 
40 hours 



Total 740 hours 



60 



S. Thiagarajan 



September 4 
December 1 



Task analysis and consultation 
with ICDS and IBMS groups 

Writing first draft of ICDS 
manual 



Editing IBVS Manual 



NCS test form design 

Assistance with video 
tape production 

Developmental testing an.d 
modification 

Preview workshop 

Training of Texas Team 



60 hours 

170 hours 
30 hours 
20 hours 

30 hours 

40 hours 
30 hours 
40 hours 



Total 



400 hours 



Jerry Olson 



September, 
October S 
November 

December 15-16 



December 



November - 
December 

December 



January S - 7 



January 10 - 14 



January 17, 20, 24 

27, 31 
February 3 



Supervisor, camera and tech- 
nical assistance for audio and 
video 

Trip to Texas for meeting with 
Service Center personnel con- 
cerning technical needs 

Coordination of audiovisual 
requirements with Texas Centers 

Work on reliability data 
in developmental testing 

Design of Observation 
Schedule 

Programming and analysis of 
PRIME preview data 

Supervision and analysis 
of Texas Training Team data 

Supervision and analysis of 
reliability data from obser- 
vation systems workshops in 
Texas 



100 hours • 

48 hours 
30 hours 
30 hours 
30 hours 
20 hours 
30 hours 



60 hours 



Total 



302 hours 
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Chad Sivasailam 



October 



October 30 - 
November 20 

January 3 

January 10-14 

January 17 - 21 



Initial draft, IPPS Programmed 
Instruction Manual and 
Training Manual 

Revision of above 

Developmental testing 

Technical help in video and 
audio tape production 

Trainer for PRIME preview 

Florida, trainee in FLACCS 

Richardson, Texas, conducting 
FLACCS workshop 



30 hours 
10 hours 
6 hours 

20 hours 
8 hours 
40 hours 

40 hours 



154 hours 



Chris Barger 



October - November 
November 



December 



Analysis and planning of 
audio instruction for ICDS 

Preparation of typescripts 
training for video tapes 
supervision and direction of 
audio taping 

Completing of audio tapes 
editing of tapes 
insertion of instructions 
for taping 

coding and preparation of 
conf iirmation 



160 hours 



160 hours 



160 hours 



480 hours 
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Meredith Adler 
CITH Project PRIME Coordinator 



Oct, 11 - 15 



Oct. 18 - 22 



Oct. 25 - 30 



Nov. 1-6 



xNov. 8-13 



Organization and planning of CITH personnel 

production teams. 

Meetings and task analysis. 

Evaluation of needs and facilities. 

Development and design of machine scorable 
coding sheets. 

Initial work on programming booklets Oct. 
20 - 22. 

Meeting in Minneapolis with Dr. Kaufman, 
Thiagarajan, Judy Agard and MCS officials 
concerning design and printing of coding 
booklets. 



40 hours 



45 hours 



Supervision of content and production of video- 
taping. Coordination with University School 
and St. Charles School concerning use of sub- 

J 6Ct S . 

Contacts with parents about parental permission 
for taping and transportation. 
Planning and ordering supplies. 
October 29, review of Project PRIME tests with 
Dr. Walter Stolz, Thiagi, and Henry Goodstein 
Oct. 30. 

Videotaping in TEL. 

Working by phone with NCS to clarify problems 
on coding booklets. 

Preparation of examples of written categories 
of ICDS. 

Supervision of scripts for audiotaping. 
Nov. 5--organizational meeting with students 
for audiotaping and rehearsal. 
Nov. 6- -videotaping in TEL. 

Supervision of developmental testing, working 
with undergraduate students from the Psychology 
Department . 

Evening session with developmental testers. 
Revision and editing IBHS II program. 
Supervision of coding by testers in Ellettsvilie 
schools. 

Audiotaping for ICDS 10-12 and 3-5 in TEL. 
Meetings with Dr. Lynch and Carole Ames for 
confirmation coding of audio- and videotapes. 
Nov. 13- -videotaping in TEL. 



55 hours 



50 hours 



48 hours 
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Nov. IS - 20 



Nov. 22 - 26 



Nov. 29 - 
Dec. 3 



Dec. 6-10 



Dec. 13 - 18 



Editing and revision of IPPS ims. Dupli- 
cation of tapes and supervision of clerical 
work on role play cards. Preparation for label- 
ing tapes. 

Production of ICDS role play tape. 
Editing and splicing audiotapes. 
Coordination of confirmation coding. 
Investigation of scoring tools (pens and pencils) 
far coding booklets. . 
Obtaining estimates on printing and distribution 

of materials. 

Completion of developmental testing. 
Communication with NCS concerning coding book- 
lets. 

Nov. final videotaping at TEL. 

Investigation of packaging and labeling of 
kits to be used by trainers, fleetings in 
Indianapolis with packagers. 
Editing and revision of ICDS audiovisual 

materials. „ . 

Planning and scheduling for PRIME Preview and 
workshop for Texas Training Team, including 
training, housing, facilities, and hospitality. 

Final work on confirmation coding and train- 
ing booklets. 

Organization meeting on scheduling of Texas 

workshops . . , 

Planning of transportation of trainers and 

equipment. . 

Editing and supervision of clerical work on 

packages . 

Final editing and packaging of audiovisual 
components. Meetings with CITH groups to 
plan data collection. 

Final proofreading of written materials. 
Dec. 10 5 11- -interviewing University of 
Texas students for selection of training 
team. 

Dec 13-15--ineeting in Texas with Service 
Center Personnel and Special Education Direc- 
tors to explain coding systems and training 

packages. -it, TTrc 

Dec 15-17--meeting in Minneapolis with NLb 
concerning coding bobklets and printing of 
training materials. 



50 hours 



40 hours 



40 hours 



50 hours 



48 hours 
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Dec 20 - 24 Dec. 20- -conference in Washington, D. C. 

with Dr. Kaufman regarding printing of training 
ni&^ e r i a 1 s • 

Work with CITH personnel concerning pretests of 
coder ability. 

Duplication of materials for PRIME Preview. 
Coordination of scheduling and facilities for 
PRIWE Preview and Texas Training Team. 



40 hours 



Dec. 27 - 31 



Jan. 3 



Jan. 9-15 



Jan. 16 - 22 



Jan. 24 - 28 



Final meetings concerning training sessions 
and data collection. 
Assembling kits of training materials. 
Meetings with trainers of each system. 

Coordination of PRIME Preview. 
Meeting \oth trainers for evaluation and 
review of training. 

Jan. meeting Texas Team in Indianapolis. 
Coordination of Texas Training Team Workshop. 
Serving as guide and hostess to Texas guests. 
Jan. 14-15— to Minneapolis, then Texas to 
supervize delivery and distribution of 
materials. 

Jan. 16-Austin, Texas Supervision of distri- 
bution depot and equipment for Texas Training 

Team. . , ^ 

Working in office coordinating arrival ot 
trainers and handling any problems concerning 
workshops, personnel, supplies, or equipment. 
Tan 17-22--distributing materials to center. 
Dealing with problems of trainers and work- 
Working with Austin staff on distribution of 
information for observation period [e.g. , over- 
views, payroll worksheets, marking labels, ana 
envelopes for data collection). 
Assisting in completing observation schedules 
for individual schools. 

Jan. 22 -23- -Workshop for trainers in Broivns- 
ville, Texas. 



40 hours 



48 hours 



70 hours 



80 hours 



Coordinating and scheduling remaining work- 
shops . 

Handling supply problems. 

Working with Special Education Supervisor on 
problems with observers. 

Completing and mailing observation schedules. 
Coordinating payroll and accounting for work- 

shops with CITH. ^i. r- i 

Assisting with travel scheduling for the final 

Seeing as liason with CITH reliability analysis. 



70 hours 
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Jan 30 - Ser^/ing as coordinator for problems arising in 70 hours 

Feb* 4 training in final week of training. 

Consulting with observers and principals 

regarding problems arising during initial 

observation period. 

Coordination of supplies and materials. 
Liason with CITH for both data analysis and 
accounting. 



Feb. 5 



Meetings with trainers and supervision of collec- 
tion and return of materials and equipment. 
Return to CITH. 
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Sample Transcript of Spontaneous 
Lesson Used in Audiotape 



ICDS PRACTICE TAPE 1, segment 3--Tro£ism 

T: Ok, class, today we're going to talk a little about tropism. 

Scott, do you know v;hat a tropisa is? 

Scott: Urn, no. 

T: Becky, do you know what a tropism is? We talked about it yester- 

day. 

Becky: Something about growth response. 

T: Ok, Growth response. Mark, can you clarify that for us a 

little? IVhat does it mean more than a growth response? 

Mark: Well, I'm not sure. 

T: Ok, do we need something for the response to happen? Like, 

suppose in a plant, and the plant bends toward the light. VJhat 
do we need for the plant to bend towards the light? Mark. 

Mark: Um, let's see.... 

T: Can anybody help him? Ok, all plants bend toward the light. 

What is it that makes them bend? Say we're outside and a plant, 
like a weed. . . 



Student: 
T: 

Becky: 
T: 

Mark : 
T: 

Mark: 
T: 



It's the wind. 

No. Now, think. Not every day we don't have wind. But every 
day what comes up? 

The sun? 

The sun. Right. The sun. The sun makes the plant bend. Yes, 
Mark? 

But what if you have a light, you know, a light, just 

Ok, let's suppose that we have a dark room, ok, and we set the 
plant in there and we take the light bulb and set it on one side 
of the plant. V/liat's going to happen, Mark? 

Well, then it will go that way. 

It will bend towards the light, right? Ok, this is going to 
happen ever)' time. All plants have a positive photo tropism. 
Does anybody know what photo means? l*at the word photo means? 
Anne, what does photo mean? 



Anne: 



Picture. 
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T: Ok, picture. That's very good. Suppose we're taking the 

picture inside. IVhat do v;e need? 

Anne^ Flashciibe. 

T: Flash. But what's flash? 

Anne: Li^t. 

T: Ok, so photo means what then? 

Anne: Light. 

T: Pdght. Very good. So when we talk about photot.ropisra we're 

talking about a light response. The plant grows toward the 
light. Ok, now there's a very good reason for this. Suppose 
we have a growth hormone, which I'll explain to you. A hormone, 
say like in our bodies, v;e have growth hormones, only this 
hormone when it comes out of our brains, will make us grow 
very tall. Well, a plant hormone has the same thing. In the 
top of the plant this growth hormone is produced and it makes 
the plant grow very tall. IVhat this hormone does is make the 
cells elongate on one side. V/liat does elongate mean, Scott? 
Do you know? 

Scott: To make longer. 

T: Ok, to make it longer. Right. Or stretch out. So. Now we've 

got this plant with the growth hormone on top and it trickles 
down through the plant. What's going to happen as this hormone 
comes dovm through the pi nt, Mark? 

Mark: Well, it will just 

T. IVhat will happen to the plant? 

flark: It'll go that way? 

T: It will go wh.ich way? 

Mark: Towards the light. 

T: Now wait. We haven't gotten to the light yet. We're just 

talking about the grovirth hormone coming down and we said that 
it made the plant enlongate. So what will happen to the plant? 

riark: It will get taller. 

T: Right. It will get taller. It will enlongate or get very 

much taller. Well, now we'll get back to the light a little 
bit. Let me tell you something about tlie oxin--this is the 
hormone that we're talking about —it's called oxin. Now, oxin 
in a plant grows away from the lipht. Ok, now what does this 
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mean? We have a light shining on one side, which way is the oxin 
in the plant going to go, Mary? 

Mary: The other way. 

T: Ok, the other way. Or opposite the light. Ok, so what's going to 

the cells on the side of the plant where the light isn't shining? 
^Vhat's going to happen to those compared to the ones on the light- 
ed side that we talked about. VJhat's this response, do you re- 
member, Laura? 

Laura: They'll get longer. 

T: Ok, they'll get longer. So when the cells on one side of the 

plant get much longer than the cells on the other side of the 
plant, what's going to happen then, Anne? 

Anne: Have a lopsided plant. 

T: Right. It's going to grow lopsided and it's going to grow what? 

Anne: Towards the sun. 

T: Towards the sun or towards the light. Nov/ does everybody under- 

stand how this works? Mary? 

Mary: I don't understand. Now you said the light, the plant, on the 
other side. 

T: Now wait, start again. 

Mary: Something about you have a light. 

T: Ok, you have a light. 

Mary: And you have a plant. 

T: Ok. Suppose. . .look up here on the board. We have a light here, 

all right, and a plant here, all right, and the light shines this 
way, ok, and oxin is all through this plant, ok, before we start. 
But then when we put light on it what happens to the oxin, after 
the light is on it, Mary? 

Mary: It goes the other way. 

T: It goes the other way. So all of our oxin is going to be on 

which side? 

Mary: On that side. And then that side gets longer? 
T: Ok, because the hormone does what to the cells? 

I'lary: I don't know, but I just know.... 
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X- Right, they elongate. So when we have long cells on this 

side and short cells on this side, Anne said we're going to 
have a lopsided plant and it's going to be lopsided in which 
way? 

Student: The side vihere it's shorter. 

T: . OTc, it's going to be lopsided on the side where it's shorter 

and so it's going to bend this direction. And that's why 
plants, when the light is shining, they bend toward t.hc lig^a 
Ok? Does everybody understand that now? 
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Test of Auditory Vi g ilance 

This packet contains sheets for the test of Auditory Vigilance. 
Administer it before you begin training on Monday morning. 
Get the tape marked Auditory vigilance and set it up. 
The test also serves as a good example of what a coding system is. 

You might introduce it that way. 

Give each trainee a tally sheet and tell them that there are two 
minutes of instructions on the tape and then six minutes of listening and 
coding . 
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DATE 



I. Tally all words that are GEOGPAPHIC PLACE miES . Proper names only, 
e.g., Bloomington, Afghanistan, Lake Erie. 

II. Tally all words that indicate the classification A^MIMALS , except 
hvnnan beings. 

III. Tally all words that indicate the classification BODIES OF WATER , 
, e.g., ocean, lake, river, etc. 

IV Tally all words that indicate ^e'BERS . Do not include relational 
quantities such as few, many, etc. Tally each number you hear. 







CATEGORY 


A (First 3 minutes) 


TOTAL 


I . GEOGRAPHIC 
PLACE NAMES 






II. ANIMALS 






III. BODIES OF 
WATER 






IV. NUMBERS 


TOTAL 


A 




B (Second 3 minutes) 




I . GEOGRAPHIC 
PLACE NAJ1ES 






II. ANIMALS 


i 




III. BODIES OF 
WATER 






IV. NUliBERS 


TOTAL 


R 




TOTAL A+E 





Pretest Data Collection Sheet 
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Trainer Name: _ 
Trainer Number: 



Region Number: _ 
District Number: 



Auditory Vigilan ce 



Category (A) 



Coder Name//Criterion= 



II 



III 



IV 



20 



Cat egory (B) 



Total A I I 
— f-z- 



45 



1. 



.3^ 
.4.. 
5. 



9^ 

JiL_ 



>J 



II 



III 



16 



IV 



Total B 



Grand' 
Total 



18 



41 



86 



Pretest Data Collection Sheet 



^gjj^^. Region Number: 
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r.Atejyorv fA") 
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IV 
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I 

7 
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IV 
1 « 
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Total 

86 ' 


lorai 
Pupil 
(P) 


Teacher 
(T) 
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IBMS Pretest of Coder Ability 

Following is a short test on the Indiana Behavior Management System 
(IBMS) . We are asking you' to take it at this time t.o give us an idea of your 
ability as a coder before you go through the observation training program. 

Before you begin this test, would you please indicate the following 
information: 

NAJffi: • DATE: SEX: 

PRIOR TEACHING EXPERIENCE (No. of years): 

SUBJECT (S) TAUGHT: . 

AGE (Be honest— we won't teill anyone): 

HIGHEST DEGREE RECEIVED: . 

L. HAVE YOU EVER CODED OR RATED CLASSROOM BEHAVIOR USING AN OBSERVATION 

SYSTEM BEFORE? ( ) Yes ( ) No 

2. IF SO., VJHAT KIND OF OBSERVATION SYSTEM DID YOU USE? 

A. Name of system: 

B. Brief description of system: _ 



Introduction 

This test is divided into three sections. It is rather short -you will 
spend less than 15 minutes on it. In the first section, you will be given 
10 minutes to read and memorize the descriptions of 5 pupil and 5 teacher 
behavior categories of the IBMS. In Section II you will have 1 1/2 minutes 
to write down from memory the names and abbreviations of all the categories 
that you have just read about. Following this, in Section III you will be 
given 1 1/2 minutes to code a short transcript of classroom behavior. 
Q STOPi!! DO NOT TUI^j^I TO THE NEXT PAGE UNTIL INSTRUCTED TO DO SO. 
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SECTION I 

You will be given a maximum of 10 minutes to read and memorize the 
following IBMS category descriptions. Begin reading now. 

EXCERPTS FROM IBMS II ABRIDGED CODERS S T^ANl^AL 
PUPIL CATEGORIES 

Task Behavior 



1. task (t) 

•'I'm doing what I'm supposed 
to.'' 



Pupil's head and eyes are orient- 
ed towards persons or objects re- 
lated to the lesson or lesson 
instructions. '^Lesson'' is defin- 
ed by the teacher. 



Off -Task Behavior 



2 . self- involvement (si) 

••I'm minding my o\m business, 



Student is "alone*' and quiet . No 
verbal or physical interaction with 
others, e.g., staring, daydreaming, 
playing with self or other object, 
muttering to self, wandering around 
by himself, sleeping. 



3. physical interaction (pi) 



''I'm playing with someone else 
but I'm not angry/' 



Non-verbal interact ions that are 
not aggressive: playing a game, 
passing notes, touching someone 
else. 



ERIC 
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Pupil Off-Task Behavior (continued) 



4. verbal aggression (va) 


Insulting, abusive, angry statements 
directed to peers and/or teacher. 


"I'm anery and I'm telling 
you about it." 




5. verbal resistance (vr) 


Verbal refusal to CARRY OUT TEACHER 
DIRECTIONS- -either to do a par- 
ticular task or to stop misbehaving. 

This ONLY occurs uurmg ail xiii-^x 
action with the teacher. 


"I won't." 


Rule: If verbal resistance (vr) 
and verbal aggression (va) 
occur together, code only vr. 



80 

Task Behavior 



TEACHER CATEGORIES 



1. Task (T) 

''I'm marching to the beat 
of my own drum/' 

-or- • 

("I'm doin' my o\«i-thing.") 



Any teacher behavior related to 
lesson, whether social or aca- 
demic. In general, this includ 
es all teacher' behavior which 
has not been initiated by a 
pupil off -task behavior. 



Teacher Control Behavior is always initiated by a pupil's off-task 
behavior. The teacher responds in one of the following control 
categories : 



2. Demand (D) Direct verbal commands to "cease 

and desist" in firm, authorita- 
tive tone. No pupil response 
expected, e.g., 'Be quietl" 

•I want you to ^" (atop 

doing what you're doing) - 



3. Value Law (VL) Teacher explicitly reminds pupil 

of the established rules of be- 
havior in the classroom by de- 
scribing or referring to a 
norm o f behavior. E.g. , "You 
know we raise our hands when 
"Vte must . . . ." we wish to speak.'' 
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Teacher Control Behavior (continued) 



9. 


Consequences (Q+) 
CQ-) 

"If you (behave 
this way) , then 
(this will happen.)*' 


Verbal statements stating or imply- 
ing consequences to behavior. Incen- 
tives, rewards, or promises are posi- 
tive consequences fQ+) ; threats are 
negative consequences (Q-)- 


10. 


Redirection (R) 


Teacher subtle use of ''task'' to con- 

trol mlSDCnaVlOr , a pobiLXVC xcxu^w-o 

of attention without reference to 
the misbehavior. Verbal or physical, 
but not punitive e.g., "Will you 
read the next paragraph, John?" 'IVill 
you and George change seats for to- 
day?" 


GENEPAL CODING RULES: 




1. 


If the teacher is silent during an interaction with a pupil, 
continue coding whatever behavior the teacher was previously en- 
gaged in. 



2. Following a teacher Redirection (K) , as soon as the pupil 

appropriately responds to the teacher's redirecting statement or 
question, then you code both the pupil and the teacher as on-task. 
(This is the only exception to Rule #1.) 



STOP! DO NOT TURN TO THE NEXT PAGE UNTIL INSTRUCTED TO DO SO. 
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SECTION II 

You have 1 1/2 minutes to ^^ite down all the categories and their 
respective abbreviations that you have read about. Write them in 
any order in the space provided below. You are not allowed to turn 
back and refer to the \n-itten material that you have read. 



PUPIL BEFfAVIORS TFACHER BEHAVIORS 



Name of Category 


Abb rev. 


Name of Category 


Abbrev . 


1. 


t 

1 


1. 




2. 




2. 




3. 




3 ■ 




4. 




4. 




5. 


1 

» 


5. 

I ■ ' ■ ■ ■ 






1 

i 
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SECTION III 

In this section you will have 1 1/2 minutes to code the following 
script. You may refer back to the IBMS category descriptions if you like, 
but remember that you have only 1 1/2 minutes to code the entire script 
and this could prevent you from finishing it. 
Method of Coding : 

Since we are interested in what the pupil and the teacher are doing 
at the same time, notice how the following examples of each teacher and 
pupil behavior are paired. Directly across from each pupil behavior is the 
teacher behavior that is happening" at the same time. You are to assume 
that each set of examples is arranged sequentially in time . This means 
that Example #2 immediately follows Example #1, Example #3 immediately 
follows #2, etc. Look at the following set of examples. 

PUPIL TEACHER 

1 P: Melvyn (Looking out T_T: (Writing homework assignment 

window) on blackboard.) 

2 -<Lp: (Drawing designs on the- Zj- "This assignment is to be hand- 
* ^ — back of his notebook) ... ed in on Friday." 

3. tj': (Looking at teacher) .... Cj- "Melvyn, pay attention." 

Notice that the code letters have been written to the LEFT of each 
example of pupil behavior and to the LEFT of the teacher behavior occurring 
at the same time. This is the way you are to code the following script. 
If you have any Questions about the procedure you are to use in coding the 
following script, ask them now. 



'do not TURI>I TO THE N:XT P/.GE UNTIL INSTRUCTED TO DO SO. 
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Learning Situation : Art period. The teacher, Mr. Van Stopp, is sitting 
at his desk grading papers. He has instructed the pupils to draw pictures 
of a scene that they have just read a story about- The pupil you are 
coding is I.M* Krafty. 



PUPIL BEH)^.VIO? 
(I.M. KPAFTY) 

1. P: (Wandering around looking at 

the goldfish in the aquarium) . . 



3. 



P: (Listening to Teacher) 



P: (Goes to desk, gets drawing and 
walks toward teacher's desk) . . . - 



4. P: (Showing teacher his drawing)... 



5. P: (Sitting at desk, drawing) ^ 

6. P: (I.M. is passing notes back 

and forth to Sue) 

7. P: (Listening to teacher) 

8. P: '*I don't wanna draw any more. 

9. P: (Looking at teacher) 

10. P: "That^s a bunch of baloney-- 

you're a strict old grouch!'' 

11. P: (Looking at teacher) 



TEACHER BEHAVIOR 
(fir. Van Stopp) 

T: (Working at desk) 



JT: "Hey, I.M. , why 
~ don't you show me 
what you've dravm- 



T: (Waiting on I.M.) 



T: *'0.K. , that's not 
too bad. V/!iy don't 
you try to draw 
another one." 

T: (Working at desk) 



T: (Working) 



T: 'Tut those notes 
away, and get to 
work, you tv/o.'* 

_T: (Hands on hips, 
" looking at I.M.) 

T: "You know that 
~~ you're supposed 
to be doing art 
during Art Period." 



T: (Looks somewhat 
startled.) 



T : "Any more talk 

like that and I'll 
wash your mouth 
out with soap." 

STOP \^nm YOU ARE INSTRUCTED TO DO SO. PUT YOUR PENCIL DOm AND DO 
NOT 'VRITE ANY flORE. WAIT FOR FURTHER INSTRUCTIONS FROM YOUR INSTRUC- 
TOR. 
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A. Would you now please turn back to page 82 and score it. Give yourself 

one point for each coorrect category name and one point for each correct 

category abbreviation: Number Correct for Pupil Behavior: ^ 

Number Correct for Teacher Behavior 

B. Mow we would like you to score the script on page 8, using the correct 
codes given below. Mark an '^X'^ through each incorrect code and each code 
space that you left blank. Count up the number of ''X's" and put that num- 
ber in the blank for ' NW^BER INC^PPJECT'* (below). Subtract this number from 
22, and put the resulting answer in the blank> for 'WtBER CORRECT.'* 
CORRECT CODES FOR PRECEDING SCRIPT: 



1. 


PUPIL 

SI 


TEACl-CER 
T 


7. 


PUPIL 
t 


TEACHER 
D 


2. 


t 


R 


8. 


vr 


D 


3. 


t 


T 


9. 


t 


VL 


4. 


t 


T 


10. 


va 


VL 


S. 


t 


T 


11. 


t 


0- 


6. 


pi 


T 









How well did you do? NLmER CORRECT: NUMBER INCORRECT: 

Thank you for taking this test. Coding the preceding script was a 
simulation of the kind of activity that you will be engaged in when you 
code in the IBMS--only instead of reading descriptions of pupil and teacher 
behavior, you will be actually observing them in the classroom, of course. 

If you have not gone through the I EMS training program at this time, 
do not worry if you felt that you may have done poorly on this test. That's 
why we have a training progTam--to help you successfully learn the IBMS. 
If you felt that you may have done fairly well, we hope that the training 
program will reinforce the parts that you have learned in this test. 

If you have already completed the training program, we hope that tak- 
ing this test was as natural as brushing your teeth. 

Thanks again, '^'ay the Tooth Fairy bring you many happy days of coding. 
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^ata Tol lection ^ules 

Please read these rules very carefully prior to visiting your observation 
assignment. 

A. Check off each item prior to leaving the Special Fducation Office: 

Al I know exactly where to ^tc to get to my school. 

A2 I know the name of the teacher and class I will visit today. 

A3 I know the name and identification number of the child to be observed. 

A4 I know the identification code for the school district (Box ttl) . 

AS I know the school code number (Box #2) , 

A6 I know the teacher's code number (Box #3). 

A7 The child to be observed is a: Experimental pupil 

Contrast pupil 

A8 T know the child's I. D. number (Box #4 or 5). 

A9 I know the grade to be filled in (Box #6). 

AlO I know my observer's number (Box ^7). 

All I know what observation system to use today. 

A12 I have a sufficient supply of coding booklets (30 per day) . 

A13 I have a sufficient supply of No. 2 i^encils. 

(Remember to use ^2 pencils only on coding booklets.) 

A14 I have reviewed the observation system codes to he used today. 
A15 I have a wrist watch. 
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Observation Coding Rules 



Read prior to entering your school assignment each day. 

A. Check off each item to indicate that you have read each rule. 

Al Always double check on your assignment for the day so that ynu can 
complete page two— Boxes 2. 3, 4 or 5, 6, 8, snd 10. 

A2 Arrive at your school at least 1/2 hour prior to the beginning of 
the school day. 

A3 Report to the principal's office and give the^ secretary or principal 
the following information. 

A3a: Your name. 

A3b: Indicate that you are a Project PRIME observer. 

A3c- Indicate your child assignment and homeroom 

teacher's name if you know it. Otherwise, ask 
the secretary or principal the name of the child s 
first teacher. 

A4 Never under any circumstances should you argue with personnel in 
the school. In the event of any difficulties. P°li^f ^ ^f' ^° 
the telephone and call the PRM Regional Office in Austin (call 
person-to-person, collect-if not accepted, leave your name and the 
Sumber you are calling from. You will receive a call withm 5 or 
10 minutes.) 

ASa- Introduce yourself to the teacher as a coder for Project PRIME 
DO not discuss the study with the teacher unless absolutely, 
necessary. If necessary, assure the teacher that your coding 
will in no way reflect on her teaching skills and that all , 
materials collected will maintain the anonimity of both the 
children and the teacher. If a teacher asks to see what you 
are coding, you may show her an unfilled booklet and explain 
v/hat you're doing. . - . 

A5b- Some Special Education Directors may have alternative methods 
■ for introducing you to the children. Follow the procedures 
of the Director in that case. 

Some teachers like to introduce visitors to the class. If a 
teacher wishes to do this, have her say, "This is 



A5c 



She (he) will be visiting our class for a iihile and taking 
notes on what we are doing. She (he) will be busy taking 
notes so try not to bother her (him)." 

A6 Ask the teacher if she can point out to you the child (E or C) whom 
you will be coding for the day. Immediately ^5°%^.^^ 
the child and try to associate him with some distinguishing charac 
^eristic(e.g.. color of clothing, height, weight, physical charac- 
teristics.) 



id 
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A6a: Ask the teacher for the niimber of children enrolled and note on 
paper . 

A6b; Ask the teacher if the class is a regular or a special class 
(resource class, Plan A class) and note. 

A7 Explain to the teacher that you will be following the child to other 
classes. Ask her for his daily schedule if he will be leaving the 
room. Note when he is scheduled to leave, where he is going, and be 
certain that you can find that location. (Note: In some cases, these 
schedules may be available through the principal's of£ice--ask about 
it when you arrive.) 

A8 Find a good vantage point to code from, then ask the teacher if you 
can sit there. Take your position immediately. 

A9 Follow these observation rules eyeful ly: 

A9a: Complete all data on inside front cover of the coding 
booklet (Use #2 pencil only). 

A9b: In the event of an error, erase thoroughly and then 
proceed to fill in the correct data. 

A9c: After completing Boxes 1, 2, 3, 4 or 5, 6, 8 and 10, 
-complete Box #11 (from your note paper) 
-count the number of children present in the room and 
complete #llb ' u ^ 

-comi>lete Box #12 (from information obtained from teacher) 

A9d: Observe the physical environment of the classroom and com- 
plete Box #13. 

A9e: Note the number of adults in the classroom and what they 
are doing- -complete Box #14. (Remember, do not count 
yourself or other Project PRIT^E observers; however, you 
do count Project PRIME people who are administering paper 
and pencil tests.) 

A9f: Note classroom displays, centers, etc. and complete #15. 



AlO You are now ready to code . 

AlOa: Try to catch the beginning activities of the day. A good cue 
is if and when the class is called to order by the teacher or 
if the teacher interacts with a child or children on any school - 
related matter (including routine matters, e.g., milk collection, 
attendance, etc.) 

AlOb: Log in the time started. (Box #16) 

AlOc: General Rules 

a. IVhenever a lesson or activity changes, immediately stop cod- 
ing, log out time and complete the status data Boxes (#17, 

• 18, 19, 20, 21 and 22). 

b. Turn the page quickly, log in (Box #16) and continue to 
code. 

c. remember to complete all SD data (Boxes 17 through 23) at 
standard intervals. 

AlOd: Code all activities no matter what they are. Always complete 
the status data at the standard intervals. 

98 
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All If your F or C pupil leaves the room to go to another class, be 

certain to follow him to that class— introduce yourself to the new 
teacher and proceed as follows: 

Alia: Use a completely * fresh coding sheet booklet . 
Allb: Complete all data on inside front cover as before and 
proceed to code. 

^Remember: 

r. Always use a new booklet for a new class and teacher 
during the day; 

II. Always complete inside front cover of booklets before 
proceeding to code. 

III. When using a new booklet in the same room, follow the 
same directions as for the first booklet--complete all 
data on inside front cover and proceed to code. 

IV. Always start a new page in the booklet when a new 
activity is started in a classroom. 

A12 General Rules for Accompanying Children to Classes. 

A12a: IVhen accompanying a child to another room, try to be as 

unobtrusive as possible. Try to avoid raising the anxiety 
in the child. If you know exactly where he is going, try to 
get there before or after he arrives. 

A12b: Follow rules for introducing yourself to his teacher (Note: 
It is obviously not necessary to be introduced to the 
child.) 

*Note; Remember to obtain all information necessary to 
complete all boxes on inside front cover of new 
booklet. 

A12c: If you arrive at a class with mote than one other observer, 
follow these rules: 

a. If two observers are already in the room, DO NOT ATTEMPT 
TO OBSERVE YOUR CHILD. Ask the teacher, if you don't 
already know, when and where the child will go next, take 
a breather and pick him up at the next period. There 
should not be three or more observers in the rdom at one 
time. 

Remember: Avoid confusion in front of the teacher AT ALL TIMES. 

b. If more than two observers meet at any one class, always 
select two observers who are observing E children and 
the others observing C children are to take a breather. 
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A13 Pacing observations wit}iin a class. 

You will undoubtedly experience fatigue when required to code for a 
full day in the sanie class. Please try to follow these rules carefully^ 

A13a: Always code between 8:30 and 11:30 a.m. and between Ip.m. and 

2: 30 p.m. if possible. 
A13b: Vihenever you^re in doubt about when to code, don't hesitate to 

code, code, code. 

Remember: In many, many cases you will have to wait for long periods of 
time to code on certain observation schedules. It is very 
important that you continue to look and listen during these 
intervals and that you remember to complete the status data 
boxes at the appropriate times. 

The status data is as important as the other observation data, 
so be vigilant even during slow coding or non -coding periods. 

A13c: IVhenever an activity or lesson changes, remember to complete 
the status data boxes and start coding a new page. When you 
complete a booklet, complete all the data on the back and 
start a new one. 

A13d: Whenever the teacher changes or the pupil goes to a new class, 
change books. 

A13e: Whenever you must change booklets for lack of coding space, 

within a lesson, don't panic. Make certain that you complete 
all data on the new booklet, complete all the data on the back 
sheet and start a new one. 

Remember: If a booklet is not properly identified, it will have to be 
discarded- -and all your work will "go down the dram.'' 



A14 Processing completed booklets, 
fully. 



You must follow these rules very core- 



A14a: 



A14b; 



A14c: 



A14d: 



Upon completing a booklet, place it in a safe place (i.e., in 

an open attache case, on the floor next to your handbag, etc.) 

Never let the completed booklets out of your possession. 

V/hen leaving the room for any reason, take them with you. 

At the end of the day, place all your completed booklets in the 

envelope provided and MAIL IT If >?EDIATELY. 

Treat the booklets as you would your own valuables. They 

represent many hours of your work. 




Check List Prior To Leaving Your School At The End Of The Day 
Check before leaving: 

1. Check that all booklets have proper identification (Boxes 1, 2, etc.)- 

2. Place all booklets in appropriate envelope and seal them, 

3. Go to the principal's office and thank everyone. Tell them (if you 
know) when you will be back in that school. 

A. Report any problems to 'the Special Education Director and/ or the 
Austin Office of Project PRIME and write them on the Problem 
Report Sheet. . . 

5. Mail the envelopes. 

6. Fill in the appropriate Time Record Sheet, 
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Observations of a Workshop Trainer 



Sunday afternoon, January 30, Nancy Derryberry add I (Anne Briggs) 
arrived in Waco. We first contacted Jack M. Ross, the Director of Services 
to the Handicapped at the Education Service Center, Region XII. Jack took 
us to the Church of the Holy Spirit, the place we would be holding our 
workshop the coming week. As soon as we walked in, we saw that we had a 
very good "set vp,'* i.e., location, equipment, and personnel available to 
answer questions. There were several reasons for our good fortune. First, 
this was Jack's church; he knew the minister; he showed us the location of 
the thermostat, restrooms, refrigerator, telephone, etc; he took complete 
charge of creature comforts, e.g., he was at the church early every morning 
making coffee for us and he came to clean up every evening after we had gone 
home. Second, ours was the last week of training— since all the bugs with 
equipment and materials had been worked out, we had just about everything 
we needed. Third, Jack's wife had been an ICDS trainee the first week, 
so he gave us tips about how to treat Waco people and even how to organize 
snacks I 

We had the use of a doiible Sunday School room with four long tables 
and 30 chairs. We used two 19 inch monitors to train 23 people. (Ideally 
we should have had one monitor per S trainees— to make the fine visual 
discrimination required, the trainee needs to be close to the monitor. 
Nevertheless, we were fortunate to have two monitors.) The training manuals, 
training booklets, and coding booklets were alrea«fy at the church. We 
brou^t our video tapes with us. Later in the week we made plans to adapt 
the roleplaying part of the package to the large group. Jack was able to 
supply us with two additional audio tape recorders and two blank tapes. 

We had very little difficulty with the principals of the schools in 
which our trainees practiced coding. The difficulties we had were easily 
overcome: no ladies in pants-suits and plenty of prior notification of our 
presence in the school. 

At the end of the week we made arrangements with Jack to return all 
equipment. Coding booklets stayed in Waco for the observers; I brought a 
monitor, a tape deck, and boxes of manuals with me back to Austin. 

We did have several problems. One, we had too many people to train 
at once, so we couldn't give them the individual attention they needed. Two, 
the necessary time limit of one week was too short for many of the trainees, 
who, having never experienced this kind of training before, felt rushed, 
frustrated, and defeated. 

At the end of the week, however, we were pleased with our group. We 
felt we had broadened their horizons considerably by our training. They 
learned different ways to view and therefore evaluate classrooms; they 
learned about CITK at Indiana University; they learned about PRIME; and most 
important, they learned something about education in the State of Texas. 
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Audiovisual Survey of Regional Service Centers 



SECTION I VIDEOTAPE RECORDERS 

1. Do you have any Videotape Recorders (VTR)? (Y) (N) 

^ If NO go to question #9. 

2. How many do you have? 



3. Are they Sonys? (Y) (N) 



If YES go to Section II. 



5. IVhat make and model # is/are your unit(s)? 



6. Is/are your unit(s) compatible with the Sony AV 5600/AV5000 unit? 
(Y) (N) 

> If YES go to Section II. 



Do you have facilities for dubbing (copying) videotapes so that your 
equipment may be used? (Y) (N) 

^ If YES go to Section II. 



Do you have access to any facilities for dubbing tapes to be compatible 
with your equipment? (Y) (N) ^ 

^ If YES, go to Section II. 



9. Can you borrow any units? (Y) Qi) 

^ 80 Section II. 

9A. Vihat type? 



SECTION 1 1 AUDIOTAPE RECORDERS 

10. Do you have access to over 5 reel-to-reel audiotape recorders (ATR) with 
a tape speed of 3 3/4 ips? (Y) (N) 

~>lf YES, go to question 15. 

11. Do you have any other types of ATRS? (Y) (N) 

•:^If NO, go to question 14. 



10:. 
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12, Do you have facilities for dubbing audiotapes so that your equip- 
ment may be used? (Y) (N) 



If YES, go to question 15. 



15. Do you have access to any facilities for dubbing audiotapes to be 
compatible with your equipment? (Y) (N)_ 

^ If NO, go to Section IV. 



14. Can you borrow any? (Y) (N) 

, ^ If NO, go to Section IV. 

15. Do you have any earphones for each ATR? (Y) (N) 

^If YES , go to Section IV. 

16. Can you borrow any? (Y) (N) 



SECTION III--SERVICE 

17. Do you have VTR and ATR service locally? (i.e., schools, shop, 
etc.) (Y) (N) 



-^If NO^, go to question 21, 



18. Do you have fast service available? (Y) Qi) 

19. Do you have the possibility of a back-up VTR and ATR unit(s)? 
(Y) CN) 

N Tf NO, go to question 21. 



(N) 



20. How many back-up units? 
VIDEO: AUDIO: 

21. Do you have any video and audio splicing tape equipment? (Y)^ 
— — ^ If NO, go to question 23. 

22. VJhidx equipment do you have? 

23. Do you know how to perform local maintenance (i.e clean tape heads)/ 
(V) (N) 



EQUIPMENT: 

SPACE: 

CLASSROOMS: 



Octobes' 
1971 



Nov. 



Dec; 



Aadio-Visuoi 
Prod«iction 



Material 
OsvslopmeRt 



AdiTimjist ration 

- a ■ 

ExecuttjcSii 



Troining 



Production 
of video 
training 
t topas 



Oesi^n of : 
coding: book*; 
a dovelolinnent 

of proglrd'^^ 
monuois . 



Production of 
' vls^o tapes 
*'conf if motion 
coding 



Orgdnizeitiona^ 
tosit onoiysis 
fevoiuotion 
}Qi ordering 



Revision ft 
editing of 
programmed 



Editing & 
revision of 
AV moteriais 
ond role 
ploy units 




Oev^lopmentisl 
testing of 

programmed a 
A V. moteriuls 



Finoi editing of 
written matericis 
f development 
of pretest of 
coder obility 



Schedulirig train- 
fng f .duplication 
a podcoging of 
materioi^ 

traifiihg 
team, selection 



Continue^: . . 
4H>j deveioj^ental 
testing 



Systems Flcwchart for CITH Activuies in Project PRIME 
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of pretest of 
coder ability 



Scheduliiig train- 
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testing 



Design Reliobilfty 

a. ■ 
Data Analysis 



Development 
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design , 
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•Jan. 
1972 



Fab. 



Mar. 



Apr- 



Way 



Develop, of TEA 
A'Jmin. Test 



Distribution 
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